-- Logs begin at Wed 2022-08-31 06:09:54 UTC, end at Wed 2022-08-31 07:20:26 UTC. -- Aug 31 06:52:53.683609 dv-cinder-855288-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 06:52:53.692009 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 06:52:53.695027 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 06:52:53 2022] *** Aug 31 06:52:53.695184 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 06:52:53.695296 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 06:52:53.695497 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: nodename: dv-cinder-855288-3-iscsi Aug 31 06:52:53.695599 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: machine: x86_64 Aug 31 06:52:53.695688 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: clock source: unix Aug 31 06:52:53.695770 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: pcre jit disabled Aug 31 06:52:53.695853 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: detected number of CPU cores: 4 Aug 31 06:52:53.695948 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: current working directory: / Aug 31 06:52:53.696067 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: detected binary path: /usr/bin/uwsgi-core Aug 31 06:52:53.696067 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: your processes number limit is 47680 Aug 31 06:52:53.696067 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: your memory page size is 4096 bytes Aug 31 06:52:53.696067 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: detected max file descriptor number: 2048 Aug 31 06:52:53.696067 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: lock engine: pthread robust mutexes Aug 31 06:52:53.696418 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: thunder lock: enabled Aug 31 06:52:53.696418 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 06:52:53.696543 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 06:52:53.735920 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: Python main interpreter initialized at 0x56369871f9c0 Aug 31 06:52:53.735920 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: python threads support enabled Aug 31 06:52:53.735920 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: your server socket listen backlog is limited to 100 connections Aug 31 06:52:53.735920 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: your mercy for graceful operations on workers is 90 seconds Aug 31 06:52:53.736298 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 06:52:53.736298 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: *** Operational MODE: preforking *** Aug 31 06:52:53.736588 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: *** uWSGI is running in multiple interpreter mode *** Aug 31 06:52:53.736588 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: spawned uWSGI master process (pid: 105586) Aug 31 06:52:53.736801 dv-cinder-855288-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 06:52:53.739839 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: spawned uWSGI worker 1 (pid: 105587, cores: 1) Aug 31 06:52:53.739839 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: spawned uWSGI worker 2 (pid: 105588, cores: 1) Aug 31 06:52:53.739839 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 06:52:54.390603 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 06:52:54.391333 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 06:52:55.455635 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 06:52:55.455635 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: from cryptography.utils import int_from_bytes Aug 31 06:52:55.456346 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 06:52:55.456346 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: from cryptography.utils import int_from_bytes Aug 31 06:52:55.456457 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 06:52:55.456457 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: from cryptography.utils import int_from_bytes Aug 31 06:52:55.456857 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 06:52:55.456857 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: from cryptography.utils import int_from_bytes Aug 31 06:52:57.914670 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 06:52:57.915291 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 06:52:57.915389 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 06:52:57.915732 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 06:52:57.915810 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 06:52:57.915883 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 06:52:57.915952 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 06:52:57.916017 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 06:52:57.916282 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 06:52:57.916430 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.916573 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 06:52:57.916715 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.916951 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.917081 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.917249 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.917368 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.917595 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.917723 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.917881 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.918075 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.918209 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.918288 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.918519 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.918689 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.918838 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.918978 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.919156 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.919285 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.919520 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.919671 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.919824 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-3-iscsi {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.919932 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.920163 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.920305 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.920451 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.920545 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-3-iscsi {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.920770 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.920913 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.921047 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.921152 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.921369 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.921507 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.921666 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.921757 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.921955 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.922085 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.922280 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.922412 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.922534 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.923623 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.923758 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.923877 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.923963 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924103 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924195 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924274 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924388 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924462 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924550 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924629 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924705 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924781 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924900 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.924994 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.925125 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.925251 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.925440 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.925559 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.925757 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.925958 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-3-iscsi {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.926047 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.926274 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.926430 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-3-iscsi {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.926584 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.926727 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.926929 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.927052 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.927301 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.927416 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.927613 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.927720 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.927916 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.928037 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.928227 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.928333 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.928543 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.928649 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.928848 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.928955 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.929150 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.929255 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.929461 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.929567 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.929777 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.929885 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.930094 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.930198 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.930393 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.930494 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.930728 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.930921 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.931015 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.931096 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.931343 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.931455 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.931639 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.931772 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.931939 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.932043 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.932189 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.932292 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.932478 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.932565 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.932785 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.932873 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933096 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933197 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933411 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933500 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933656 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933745 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933903 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.933993 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.934197 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.934377 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.934560 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.934713 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.934893 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.935168 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.935257 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.935482 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.935571 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.935783 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.935873 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.936087 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.936182 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.936389 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.936485 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.936676 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.936785 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.936977 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.937067 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.937282 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.937383 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.937595 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.937693 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.937904 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.937993 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.938221 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.938323 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.938526 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.938624 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.938864 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.938955 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.939255 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.939359 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.939522 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.939634 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.939821 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.939909 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.940151 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.940249 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.940462 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.940550 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.940766 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.940864 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.941075 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.941174 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.941391 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.941479 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.941693 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.941834 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.941989 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.942088 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.942308 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.942395 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.942617 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.942713 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.942964 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.943072 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.943245 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.943329 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.943489 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.943586 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.943787 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.943873 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.944085 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.944167 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.944394 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.944485 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.944694 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.944778 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.944994 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.945076 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.945293 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.945386 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.945588 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.945672 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.945888 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.945970 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.946186 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.946279 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.946485 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.946575 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.946787 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.946911 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.947112 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.947222 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.947408 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.947498 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.947708 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.947796 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.948006 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.948104 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.948299 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.948388 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.948609 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.948698 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.948922 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.949025 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.949222 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.949322 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.949520 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.949609 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.949822 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.949968 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.950183 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.950286 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.950879 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951228 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951228 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951418 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951502 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951581 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951661 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951738 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951844 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.951940 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.952133 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.952224 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.952423 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.952541 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.952724 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.952880 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.953014 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.953149 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.953308 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.953436 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.953603 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.953735 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.953904 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.954032 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.954218 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.954351 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.954521 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.954656 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.954825 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.954987 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.955146 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.955240 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.955447 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.955533 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.955745 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.955838 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.956045 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.956130 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.956341 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.956426 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.956639 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.956729 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.956933 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.957038 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.957242 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.957335 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.957555 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.957639 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.957856 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.957951 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.958154 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.958238 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.958451 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.958533 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.958765 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.958895 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 06:52:57.959120 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.959217 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.959445 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.959541 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.959780 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.959884 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.960089 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.960176 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.960416 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.960503 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.960742 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.960838 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.961054 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.961149 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.961359 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.961455 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.961668 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.961755 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.961988 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.962083 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.962299 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.962390 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.962603 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.962692 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.962931 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.963020 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.963248 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.963348 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.963565 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.963673 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.963888 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.963999 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.964202 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.964292 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.964504 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.964600 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.964818 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.964914 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.965122 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.965209 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.965433 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.965580 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.965878 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.965975 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.966199 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.966301 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.966505 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.966593 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.966867 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.966958 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.967207 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.967309 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.967516 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.967605 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.967835 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.967923 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.968154 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.968256 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.968463 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.968550 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.968770 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.968856 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.969073 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.969170 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.969389 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.969476 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.969715 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.969810 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.970022 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.970116 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.970338 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.970462 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.970644 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.970768 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.970985 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.971114 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.971291 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.971415 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.971594 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.971726 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.971902 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.972030 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.972215 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.972463 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.972592 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.972713 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.972844 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.972968 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.973137 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.973264 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.973486 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.973631 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.973756 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.973876 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.974053 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.974197 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.974394 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.974529 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.974653 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.974783 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.974977 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.975107 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.975282 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.975420 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.975580 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.975705 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.975876 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.976009 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.976175 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.976308 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.976478 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.976595 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.976801 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.976927 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.977088 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.977229 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.977411 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.977537 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.977713 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.977836 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.978039 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.978164 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.978342 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.978466 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.978648 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.978772 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.978976 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.979113 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.979284 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.979410 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.979584 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.979708 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.979889 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.980024 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.980198 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.980322 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.980499 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.980624 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.980815 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.980941 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.981142 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.981283 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.981446 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.981580 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.981766 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.981893 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.982071 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.982198 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.982383 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.982596 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.982733 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.982892 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.983018 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.983155 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.983316 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.983452 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.983628 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.983755 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.983940 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.984066 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.984258 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.984412 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.984608 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.984737 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.984859 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.984983 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.985181 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.985315 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.985506 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.985631 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.985806 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.985940 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.986122 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.986247 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.986440 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.986564 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.986751 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.986920 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.987062 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.987187 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.987369 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.987503 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.987668 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.987794 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.987969 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.988094 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.988269 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.988396 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.988570 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.988702 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.988870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.988994 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.989169 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.989292 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.989467 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.989600 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.989765 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.989890 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.990064 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.990188 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.990376 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.990509 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.990679 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.990803 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.991001 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.991126 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.991303 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.991449 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.991601 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.991726 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.991935 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.992060 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.992242 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.992375 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.992632 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.992764 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.992887 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.993009 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.993215 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.993344 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.993503 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.993636 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.993809 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.993932 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.994117 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.994252 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.994423 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.994546 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.994752 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.994936 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.995074 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.995198 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.995320 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.995441 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.995642 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.995779 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.995947 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.996077 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.996260 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.996392 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.996565 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.996707 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.996929 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.997057 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.997258 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.997376 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.997646 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.997781 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.997948 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.998083 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.998262 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.998387 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.998596 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.998729 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.998948 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.999087 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.999262 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.999387 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.999580 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.999714 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:57.999884 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.000016 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.000195 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.000321 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.000501 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.000627 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.000807 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.000943 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.001112 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.001249 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.001416 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.001541 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.001729 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.001853 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.002036 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.002161 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.002351 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.002477 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.002655 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.002887 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.003018 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.003140 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.003277 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.003410 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.003592 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.003720 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.003892 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.004027 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.004199 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.004332 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.004522 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.004647 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.004844 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.004985 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.005146 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.005271 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.005452 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.005578 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.005765 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.005905 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.006069 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.006209 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.006375 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.006499 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.006680 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.006813 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.007006 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.007134 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.007307 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.007429 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.007610 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.007736 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.007917 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.008041 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.008221 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.008349 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.008524 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.008660 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.008822 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.008945 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.009130 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.009253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.009435 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.009560 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.009735 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.009867 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.010036 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.010160 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.010342 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.010474 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.010660 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.010793 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.010988 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.011126 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.011306 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.011444 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.011622 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.011746 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.011923 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.012062 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.012222 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.012400 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.012567 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.012694 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.012877 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.013000 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.013180 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.013278 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.013481 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.013576 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.013783 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.013878 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.014119 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.014204 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.014440 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.014615 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.014740 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.014999 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.015130 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.015265 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.015389 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.015531 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.015666 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.015797 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.015952 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.016079 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.016259 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.016385 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.016564 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.016700 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.016880 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.017006 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.017190 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.017315 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.017493 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.017618 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.017796 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.017921 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.018104 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.018229 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.018409 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.018534 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.018713 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.018839 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.019055 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.019194 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.019360 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.019496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.019668 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.019794 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.019975 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.020108 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.020273 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.020406 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.020580 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.020703 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.020888 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.021020 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.021459 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.021585 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.021791 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.021915 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.022117 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.022326 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.022452 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.022581 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.022741 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.022890 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.023114 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.023258 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.023431 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.023571 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.023757 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.023882 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.024067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.024191 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.024369 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.024504 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.024673 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.024797 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.024973 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.025173 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.025297 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.025426 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.025557 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.025679 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.025852 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.025977 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.026152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.026277 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.026450 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.026575 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.026755 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.026902 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.027081 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.027208 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.027381 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.027504 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.027678 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.027801 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.028001 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.028179 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.028399 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.028527 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.028659 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.028781 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.028912 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.029035 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.029213 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.029338 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.029529 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.029666 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.029835 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.029960 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.030135 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.030268 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.030436 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.030578 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.030737 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.031291 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.031459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.031586 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.031762 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.031897 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.032100 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.032226 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.032426 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.032551 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.032764 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.032883 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.033062 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.033200 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.033389 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.033514 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.033668 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.033795 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.033967 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.034091 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.034267 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.034392 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.034566 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.034693 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.034891 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.035038 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.035208 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.035321 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.035507 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.035602 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.035816 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.035916 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.036120 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.036226 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.036426 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.036517 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.036730 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.036821 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.037028 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.037136 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.037330 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.037420 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.037630 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.037743 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.037934 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.038035 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.038238 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.038329 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.038535 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.038625 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.038832 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.038960 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.039159 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.039251 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.039465 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.039556 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.039764 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.039857 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.040070 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.040169 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.040369 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.040466 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.040679 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.040778 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.040978 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.041069 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.041276 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.041374 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.041572 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.041664 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.041883 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.041974 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.042188 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.042280 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.042486 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.042584 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.042800 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.043023 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.043134 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.043282 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.043431 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.043667 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.043798 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.043929 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.044117 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.044349 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.044476 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.044608 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.044748 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.044871 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.045001 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.045133 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.045257 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.045460 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.045587 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.045709 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.045831 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046038 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046172 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046295 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046418 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046541 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046676 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046801 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.046984 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.047121 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.047245 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.047367 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.047537 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.047664 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.047835 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.047974 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.048136 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.048270 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.048435 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.048562 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.048730 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.048855 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.049044 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.049168 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.049347 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.049474 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.049645 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.049768 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.049943 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.050086 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.050242 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.050374 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.050577 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.050703 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.050896 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.051038 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.051251 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.051377 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.051549 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.051675 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.051865 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.052003 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.052178 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.052302 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.052486 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.052609 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.052790 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.052916 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.053096 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.053219 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.053392 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.053517 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.053705 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.053818 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.054011 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.054103 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.054316 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.054409 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.054614 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.054712 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.054934 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.055029 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.055249 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.055348 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.055555 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.055656 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.055862 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.055964 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.056176 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.056328 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.056479 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.056610 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.056792 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.056922 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.057088 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.057219 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.057391 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.057522 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.057694 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.057825 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.057997 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.058136 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.058301 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.058432 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.058602 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.058727 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.058929 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.059071 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.059273 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.059436 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.059616 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.059742 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.059958 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.060100 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.060268 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.060396 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.060571 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.060699 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.060876 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.061012 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.061179 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.061313 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.061481 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.061608 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.061806 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.061936 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.062109 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.062246 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.062410 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.062538 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.062715 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.062869 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.063038 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.063137 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.063346 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.063440 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.063643 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.063736 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.064065 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.064157 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.064369 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.064454 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.064675 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.064760 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.064972 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.065055 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.065278 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.065373 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.065583 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.065676 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.065893 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.065976 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.066199 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.066291 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.066495 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.066578 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.066925 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.067014 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.067235 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.067332 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.067543 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.067628 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.067847 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.067938 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.068145 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.068239 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.068444 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.068535 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.068748 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.068840 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.069065 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.069152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.069364 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.069448 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.069661 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.069744 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.069959 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.070046 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.070273 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.070356 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.070572 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.070655 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.070901 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.070989 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.071315 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.071400 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.071622 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.071708 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.071929 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.072013 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.072341 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.072429 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.072636 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.072729 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.072941 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.073025 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.073256 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.073386 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.073567 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.073658 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.073880 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.073974 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.074186 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.074279 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.074492 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.074576 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.074794 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.074947 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.075155 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.075246 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.075473 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.075590 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.075780 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.075906 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.076090 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.076221 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.076389 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.076524 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.076705 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.076845 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.077019 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.077166 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.077326 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.077479 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.077641 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.077798 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.078048 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.078209 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.078368 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.078531 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.078677 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.078860 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.079025 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.079182 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.079350 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.079505 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.079650 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.079807 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.079950 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.080111 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.080256 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.080422 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.080556 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.080726 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.080855 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.081030 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.081171 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.081349 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.081468 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.081651 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.081779 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.081965 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.082087 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.082276 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.082391 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.082582 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.082689 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.082907 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.083017 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.083213 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.083333 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.083531 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.083631 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.083837 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.083932 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.084154 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.084240 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.084465 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.084563 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.084783 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.084918 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.085103 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.085190 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.085405 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.085500 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.085719 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.085808 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.086022 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.086114 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.086323 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.086408 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.086623 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.086718 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.086945 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.087033 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.087277 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.087363 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.087575 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.087669 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.087893 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.087986 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.088218 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.088299 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.088526 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.088612 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.088835 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.088919 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.089161 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.089244 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.089478 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.089566 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.089793 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.089878 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.090114 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.090197 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.090405 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.090491 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.090756 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.090897 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.091087 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.091172 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.091390 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.091486 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.091696 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.091781 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092002 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092167 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092308 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092393 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092606 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092689 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092906 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.092999 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.093206 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.093290 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.093506 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.093590 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.093834 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.093925 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.094115 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.094194 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.094425 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.094516 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.094727 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.094821 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.095054 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.095142 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.095356 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.095439 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.095657 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.095742 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.095983 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.096073 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.096285 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.096368 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.096602 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.096686 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.096906 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.096990 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.097222 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.097305 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.097537 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.097622 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.097846 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.097931 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.098158 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.098241 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.098471 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.098555 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.098784 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.098910 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.099123 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.099290 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.099428 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.099512 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.099736 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.099819 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.100043 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.100135 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.100354 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.100437 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.100686 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.100870 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.101188 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.101286 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.101498 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.101582 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.101815 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.101899 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.102125 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.102217 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.102435 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.102518 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.102747 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.102830 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.103081 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.103168 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.103392 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.103476 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.103699 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.103790 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.104007 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.104095 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.104313 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.104405 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.104639 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.104729 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.104957 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.105042 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.105280 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.105364 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.105595 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.105689 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.105912 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.106003 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.106249 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.106333 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.106646 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.106752 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.106893 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.106983 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.107245 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.107330 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.107550 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.107638 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.107853 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.107936 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.108162 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.108253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.108473 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.108555 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.108780 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.108863 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.109085 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.109178 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.109391 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.109474 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.109701 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.109820 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.110010 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.110105 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.110315 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.110398 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.110618 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.110701 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.110952 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.111056 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.111267 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.111353 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.111588 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.111673 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.111908 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.111992 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.112240 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.112338 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.112528 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.112613 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.112837 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.112922 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.113145 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.113351 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.113661 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.113744 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.113969 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.114062 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.114298 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.114391 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.114617 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.114707 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.114973 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.115077 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.115262 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.115346 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.115577 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.115730 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.115877 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.115970 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.116181 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.116267 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.116479 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.116573 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.116786 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.116877 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.117087 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.117172 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.117385 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.117477 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.117701 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.117785 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.118002 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.118085 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.118300 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.118400 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.118612 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.118696 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.118940 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.119177 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.119470 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.119569 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.119815 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.119914 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.120130 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.120218 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.120448 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.120533 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.120762 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.120851 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.121065 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.121155 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.121364 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.121448 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.121674 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.121944 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.122035 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.122114 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.122326 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.122413 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.122631 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.122725 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.122959 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.123062 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.123264 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.123358 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.123565 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.123651 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.123869 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.123964 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.124168 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.124249 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.124465 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.124549 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.124761 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.124855 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.125060 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.125144 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.125370 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.125453 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.125675 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.125770 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.125976 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.126060 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.126278 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.126362 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.126576 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.126669 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.126894 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.126982 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.127196 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.127280 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.127499 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.127585 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.127798 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.127882 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.128092 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.128184 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.128389 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.128477 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.128686 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.128767 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.128982 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.129065 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.129281 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.129366 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.129580 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.129663 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.129885 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.129980 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.130228 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.130314 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.130526 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.130609 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.130825 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.130947 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.131145 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.131229 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.131453 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.131536 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.131762 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.131859 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.132073 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.132155 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.132377 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.132461 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.132683 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.132779 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.133028 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.133258 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.133342 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.133800 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.133894 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.134136 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.134220 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.134458 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.134543 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.134793 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.134924 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.135148 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.135234 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.135454 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.135548 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.135757 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.135850 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.136060 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.136143 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.136378 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.136462 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.136686 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.136787 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.136993 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.137077 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.137300 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.137450 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.137659 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.137755 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.137970 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.138100 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.138279 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.138420 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.138593 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.138730 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.138926 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.139068 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.139236 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.139378 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.139545 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.139688 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.139851 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.139996 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.140159 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.140303 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.140468 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.140608 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.140776 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.140913 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.141088 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.141226 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.141427 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.141562 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.141755 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.141886 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.142075 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.142202 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.142388 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.142512 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.142706 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.142827 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.143038 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.143156 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.143347 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.143464 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.143654 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.143769 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.143961 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.144074 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.144273 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.144385 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.144601 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.144710 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.144915 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.145022 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.145217 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.145326 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.145630 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.145722 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.145939 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.146024 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.146258 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.146342 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.146575 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.146670 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.146905 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.147006 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.147227 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.147318 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.147544 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.147640 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.147852 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.147945 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.148171 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.148252 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.148476 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.148561 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.148798 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.148882 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.149134 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.149225 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.149456 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.149541 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.149774 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.149868 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.150072 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.150162 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.150373 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.150458 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.150670 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.150756 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.150998 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.151100 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.151316 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.151400 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.151622 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.151718 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.151927 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.152024 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.152225 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.152309 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.152529 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.152620 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.152826 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.152920 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.153148 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.153237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.153448 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.153627 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.153750 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.154043 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.154128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.154343 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.154429 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.154646 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.154740 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.154967 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.155068 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.155267 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.155352 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.155565 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.155660 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.156226 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.156324 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.156529 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.156621 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.156826 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.156920 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.157126 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.157211 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.157425 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.157518 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.157722 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.157885 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.158020 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.158103 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.158319 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.158410 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.158646 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.158733 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.158988 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.159069 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.159305 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.159388 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.159613 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.159699 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.159923 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.160007 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.160229 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.160320 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.160538 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.160623 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.160851 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.160934 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.161167 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.161250 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.161473 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.161560 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.161785 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.161869 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.162104 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.162198 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.162415 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.162495 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.162723 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.162803 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.163054 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.163151 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.163361 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.163448 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.163667 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.163750 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.163975 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.164068 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.164292 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.164379 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.164595 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.164720 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.164902 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.164990 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.165214 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.165298 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.165527 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.165612 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.165835 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.165920 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.166144 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.166227 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.166450 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.166535 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.166762 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.166883 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.167093 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.167179 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.167399 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.167496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.167706 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.167798 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.168013 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.168099 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.168321 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.168414 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.168661 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.168750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.168975 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.169060 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.169291 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.169384 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.169603 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.169689 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.169928 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.170013 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.170250 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.170339 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.170556 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.170648 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.170896 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.170986 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.171225 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.171313 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.171552 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.171638 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.171873 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.171958 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.172201 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.172287 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.172526 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.172610 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.172835 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.172969 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.173143 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.173231 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.173444 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.173533 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.173684 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 06:52:58.173774 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 06:52:58.173969 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 06:52:58.329795 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Registered counter for database nova_api Aug 31 06:52:58.330460 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Registered counter for database nova_api Aug 31 06:52:58.350701 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.352625 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.357546 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.359827 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.414160 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.context [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9bb752fc-b4d8-4d43-a046-f1c835bf074d(cell1) {{(pid=105587) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 06:52:58.415645 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.context [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9bb752fc-b4d8-4d43-a046-f1c835bf074d(cell1) {{(pid=105588) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 06:52:58.418027 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:52:58.418511 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:52:58.419485 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:52:58.419931 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:52:58.420143 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:52:58.420873 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:52:58.421318 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:52:58.421465 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:52:58.422192 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:52:58.422635 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:52:58.423309 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:52:58.424632 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:52:58.425270 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Registered counter for database nova_cell0 Aug 31 06:52:58.426582 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Registered counter for database nova_cell0 Aug 31 06:52:58.429418 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Registered counter for database nova_cell1 Aug 31 06:52:58.430612 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Registered counter for database nova_cell1 Aug 31 06:52:58.437197 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.439788 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.441023 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.442561 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.444421 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.447419 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.581340 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.588873 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.590149 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Registered counter for database nova_cell0 Aug 31 06:52:58.599319 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Registered counter for database nova_cell0 Aug 31 06:52:58.599769 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.605142 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.608931 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 06:52:58.615165 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 06:52:58.938702 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 06:52:58.940192 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 06:52:58.945980 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 06:52:58.947506 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 06:52:59.289886 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 06:52:59.291931 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 06:52:59.295950 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 06:52:59.298172 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 06:52:59.301205 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56369871f9c0 pid: 105587 (default app) Aug 31 06:52:59.303296 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:52:59.303428 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56369871f9c0 pid: 105588 (default app) Aug 31 06:52:59.304515 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-094b1ff0-3fa1-44e4-b83d-15a41155e8e3 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 Aug 31 06:52:59.304886 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Aug 31 06:52:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:17.567459 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:17.568766 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Aug 31 06:54:17.569472 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:17.585110 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:17.586278 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell1:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:17.587178 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell0:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:17.588119 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:18.460026 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-38857055-3be3-46b5-b9df-a32a1e19b3b4 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:18.491728 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-38857055-3be3-46b5-b9df-a32a1e19b3b4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916018 Aug 31 06:54:18.492577 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 06:54:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:20.837532 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:20.838706 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bbf91925-1fe2-410c-bde9-47e794fd2494 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 31 06:54:20.844276 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:21.286722 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-b428b830-9d4c-4d32-9fc7-9bfd813e0331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "name": "cirros256"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:21.334406 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-b428b830-9d4c-4d32-9fc7-9bfd813e0331 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488317 Aug 31 06:54:21.334985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:54:21.556970 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-9dc7987d-7e65-4b94-a845-0e96b2456932 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:21.563510 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=3 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:21.564411 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell0:SELECT=3 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:21.565166 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell1:SELECT=3 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:21.565826 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:21.629081 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-9dc7987d-7e65-4b94-a845-0e96b2456932 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284815 Aug 31 06:54:21.630021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 06:54:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:23.963850 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-b428b830-9d4c-4d32-9fc7-9bfd813e0331 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:23.964874 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-b428b830-9d4c-4d32-9fc7-9bfd813e0331 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 31 06:54:23.965284 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:24.624608 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-7878c48c-7d7c-4c07-808b-3d049091f37c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:24.668520 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-7878c48c-7d7c-4c07-808b-3d049091f37c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.696476 Aug 31 06:54:24.669466 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:54:24.681860 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d242e8ee-0881-4a32-b198-aa5ca70f7659 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:24.718997 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d242e8ee-0881-4a32-b198-aa5ca70f7659 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040966 Aug 31 06:54:24.726867 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 06:54:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:27.113129 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-7878c48c-7d7c-4c07-808b-3d049091f37c admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:27.114063 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-7878c48c-7d7c-4c07-808b-3d049091f37c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 31 06:54:27.114434 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:27.525120 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-f0c24b27-b8a3-4562-8a67-40fdf7e532a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 1024, "name": "ds1G"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:27.545496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-f0c24b27-b8a3-4562-8a67-40fdf7e532a5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424817 Aug 31 06:54:27.546077 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:54:27.558099 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f93425fe-23e0-452d-bb98-84750e93c9bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:27.582887 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f93425fe-23e0-452d-bb98-84750e93c9bd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028496 Aug 31 06:54:27.583485 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 06:54:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:30.017679 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-f0c24b27-b8a3-4562-8a67-40fdf7e532a5 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:30.018702 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-f0c24b27-b8a3-4562-8a67-40fdf7e532a5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 31 06:54:30.019135 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:30.478985 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-c0c447a7-ead0-4bb5-a641-9a201701b157 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "ram": 2048}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:30.504090 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-c0c447a7-ead0-4bb5-a641-9a201701b157 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478740 Aug 31 06:54:30.504851 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:54:30.516947 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d9907d2f-e140-4866-a8b9-48379238fb20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:30.546021 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d9907d2f-e140-4866-a8b9-48379238fb20 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032224 Aug 31 06:54:30.546808 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 06:54:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:32.863269 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-c0c447a7-ead0-4bb5-a641-9a201701b157 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:32.864251 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-c0c447a7-ead0-4bb5-a641-9a201701b157 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 31 06:54:32.864650 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:33.302498 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-24b3782d-a5f8-48c2-a863-637ffe255fd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "ram": 4096}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:33.323738 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-24b3782d-a5f8-48c2-a863-637ffe255fd7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452682 Aug 31 06:54:33.331574 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 06:54:33.336458 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-5f33d75a-1909-40b8-8d2e-5e0e7caa66df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:33.363050 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-5f33d75a-1909-40b8-8d2e-5e0e7caa66df admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030236 Aug 31 06:54:33.378902 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 06:54:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 06:54:35.723377 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-24b3782d-a5f8-48c2-a863-637ffe255fd7 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:35.724446 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-24b3782d-a5f8-48c2-a863-637ffe255fd7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Aug 31 06:54:35.724867 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:36.184450 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-826ae5a1-0a7e-4ef5-aaf3-fefcae6829c4 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:36.226256 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-826ae5a1-0a7e-4ef5-aaf3-fefcae6829c4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.494463 Aug 31 06:54:36.227088 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 06:54:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 06:54:38.739645 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-24b3782d-a5f8-48c2-a863-637ffe255fd7 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:38.740726 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-24b3782d-a5f8-48c2-a863-637ffe255fd7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001858 Aug 31 06:54:38.741211 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:39.198224 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e32910b4-5705-43d1-845d-81917f00b054 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:39.225070 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e32910b4-5705-43d1-845d-81917f00b054 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.475489 Aug 31 06:54:39.225958 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:54:39.241846 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-af63ded9-b0f8-4998-a217-eb4dba723304 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:39.270376 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-af63ded9-b0f8-4998-a217-eb4dba723304 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032745 Aug 31 06:54:39.271015 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 06:54:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:41.645332 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e32910b4-5705-43d1-845d-81917f00b054 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:41.646350 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e32910b4-5705-43d1-845d-81917f00b054 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 31 06:54:41.646790 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:42.047439 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-a3dff004-9bde-4525-b2fd-59e86e8defc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "id": "2"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:42.067583 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-a3dff004-9bde-4525-b2fd-59e86e8defc9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414613 Aug 31 06:54:42.068126 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:54:42.080338 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-ab3cd573-2da3-42be-be65-d5fafdd98c1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:42.105654 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-ab3cd573-2da3-42be-be65-d5fafdd98c1f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029118 Aug 31 06:54:42.106268 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 06:54:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:44.546233 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-a3dff004-9bde-4525-b2fd-59e86e8defc9 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:44.547992 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-a3dff004-9bde-4525-b2fd-59e86e8defc9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002288 Aug 31 06:54:44.548391 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:44.921327 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-a2672486-d91d-4d4f-97ef-8a5112accbc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "swap": 0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:44.941625 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-a2672486-d91d-4d4f-97ef-8a5112accbc2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.386853 Aug 31 06:54:44.942315 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 06:54:44.954636 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-acb10e47-97d7-4be0-acdd-22167d06a8ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:44.982348 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-acb10e47-97d7-4be0-acdd-22167d06a8ec admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031541 Aug 31 06:54:44.983261 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 06:54:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:54:47.431351 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-a2672486-d91d-4d4f-97ef-8a5112accbc2 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:47.432365 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-a2672486-d91d-4d4f-97ef-8a5112accbc2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 31 06:54:47.434962 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:47.874693 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-373d39bb-2c92-497f-97cf-3048474fd88f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "ram": 8192, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:47.881527 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:54:47.898021 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-373d39bb-2c92-497f-97cf-3048474fd88f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458149 Aug 31 06:54:47.898561 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 06:54:47.911185 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-fa5045fb-68e8-42fc-b378-2fad73ee77df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:47.937772 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-fa5045fb-68e8-42fc-b378-2fad73ee77df admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030693 Aug 31 06:54:47.938357 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 06:54:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 06:54:50.295024 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-373d39bb-2c92-497f-97cf-3048474fd88f admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:54:50.296685 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-373d39bb-2c92-497f-97cf-3048474fd88f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 Aug 31 06:54:50.298988 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:54:50.759517 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-87a161c2-2a8c-4226-b9be-59c3f40a9750 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "name": "m1.xlarge", "id": "5"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:50.782751 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-87a161c2-2a8c-4226-b9be-59c3f40a9750 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.479151 Aug 31 06:54:50.783675 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 06:54:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:54:50.797719 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-0fd62901-7854-4da0-b38d-8e4a9cc35b64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:54:50.825016 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-0fd62901-7854-4da0-b38d-8e4a9cc35b64 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032844 Aug 31 06:54:50.825794 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 06:54:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 06:55:09.503559 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-87a161c2-2a8c-4226-b9be-59c3f40a9750 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:09.504492 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-87a161c2-2a8c-4226-b9be-59c3f40a9750 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 31 06:55:09.504894 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:55:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:09.516003 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:55:09.937482 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c26b0ec7-3f32-4d97-878a-e733ce913341 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:09.956406 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-c26b0ec7-3f32-4d97-878a-e733ce913341 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.445072 Aug 31 06:55:09.956947 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 06:55:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:55:11.024815 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-87a161c2-2a8c-4226-b9be-59c3f40a9750 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:11.025827 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-87a161c2-2a8c-4226-b9be-59c3f40a9750 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 31 06:55:11.026221 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:11.585379 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d158b843-f777-41d3-97f5-7d15a42b990e admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:11.593707 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-d158b843-f777-41d3-97f5-7d15a42b990e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d158b843-f777-41d3-97f5-7d15a42b990e admin admin] Request method failure captured: Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Accept: application/json Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Connection: keep-alive Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Content-Length: 0 Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Host: 10.222.0.42 Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.90 Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjDwXOXXOJtAvaBluhVUbCVruguNIrWFd5f27SkmFsOKjyyIza8ZmO25rOvBORFTNAFjBX17JTIXTILVWbn6JXJZHUF5eDj3pqRozOU_3c1SXaZvIGklEOjBCvAK-yzVy4n45D9-_SMnfWJY1gENV5UV0Q4QQfYD3fpukRBY3pfLFw_l4 Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Role: reader,member,admin Aug 31 06:55:11.596985 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Roles: reader,member,admin Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_401290fcd7dc4e5b872551b994bb6482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant: admin Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User: admin Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Id: 6efabcfc41f2493bb1abf0c2d7f42d8c Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Name: admin Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: method: > Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: exception: Flavor 42 could not be found. Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: action_args: {'id': '42'} Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 06:55:11.598496 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:11.599459 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.600662 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d158b843-f777-41d3-97f5-7d15a42b990e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 06:55:11.601733 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d158b843-f777-41d3-97f5-7d15a42b990e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.437379 Aug 31 06:55:11.601733 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 06:55:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 06:55:11.608449 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-da10ad01-50db-456a-8d0c-0041e0e6c907 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:11.612573 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:55:11.631097 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-da10ad01-50db-456a-8d0c-0041e0e6c907 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026265 Aug 31 06:55:11.631661 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 06:55:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:55:11.642535 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-1121d8a5-1a93-495c-ae48-c2f02cc036fd admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:11.666247 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-1121d8a5-1a93-495c-ae48-c2f02cc036fd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027999 Aug 31 06:55:11.666782 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 06:55:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:55:11.680127 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8f9606e8-be58-485b-94d0-f6e0e231f359 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:11.690485 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.wsgi [None req-8f9606e8-be58-485b-94d0-f6e0e231f359 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8f9606e8-be58-485b-94d0-f6e0e231f359 admin admin] Request method failure captured: Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Accept: application/json Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Accept-Encoding: gzip, deflate Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Connection: keep-alive Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Content-Length: 0 Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Host: 10.222.0.42 Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Openstack-Api-Version: compute 2.90 Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Openstack-System-Scope: None Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: User-Agent: python-novaclient Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Auth-Token: gAAAAABjDwXOXXOJtAvaBluhVUbCVruguNIrWFd5f27SkmFsOKjyyIza8ZmO25rOvBORFTNAFjBX17JTIXTILVWbn6JXJZHUF5eDj3pqRozOU_3c1SXaZvIGklEOjBCvAK-yzVy4n45D9-_SMnfWJY1gENV5UV0Q4QQfYD3fpukRBY3pfLFw_l4 Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Domain-Id: None Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Domain-Name: None Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Identity-Status: Confirmed Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Is-Admin-Project: True Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Domain-Id: default Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Domain-Name: Default Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Name: admin Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Role: reader,member,admin Aug 31 06:55:11.695870 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Roles: reader,member,admin Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_401290fcd7dc4e5b872551b994bb6482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant: admin Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant-Name: admin Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User: admin Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Domain-Id: default Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Domain-Name: Default Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Id: 6efabcfc41f2493bb1abf0c2d7f42d8c Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Name: admin Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: method: > Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: exception: Flavor 42 could not be found. Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: action_args: {'id': '42'} Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 06:55:11.698058 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:11.699237 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:11.700489 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8f9606e8-be58-485b-94d0-f6e0e231f359 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 06:55:11.701720 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-8f9606e8-be58-485b-94d0-f6e0e231f359 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.024155 Aug 31 06:55:11.701720 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 06:55:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 06:55:12.672533 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-1121d8a5-1a93-495c-ae48-c2f02cc036fd admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:12.673542 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-1121d8a5-1a93-495c-ae48-c2f02cc036fd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 31 06:55:12.673930 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:13.229875 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-022a748d-03d6-44bc-9ccd-ba3044313a65 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:13.236680 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.wsgi [None req-022a748d-03d6-44bc-9ccd-ba3044313a65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-022a748d-03d6-44bc-9ccd-ba3044313a65 admin admin] Request method failure captured: Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Accept: application/json Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Accept-Encoding: gzip, deflate Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Connection: keep-alive Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Content-Length: 0 Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Host: 10.222.0.42 Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Openstack-Api-Version: compute 2.90 Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Openstack-System-Scope: None Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: User-Agent: python-novaclient Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Auth-Token: gAAAAABjDwXQ8BmBaS2qlpr66trbQ1cawSCEFp87S4Cpy4iqa_E04rq76RoH3QOfQ1oTxkLhChsZcY68bltXaqSZghmogmGZOs6E6mcQdWboOg9gtWVfRHZ86CGFoSfxDXalcyl5EuJb_V5vLxnq_Iuwc5Joxt0CT7QpMhbYBqG_tzz1I-nnLas Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Domain-Id: None Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Domain-Name: None Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Identity-Status: Confirmed Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Is-Admin-Project: True Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Domain-Id: default Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Domain-Name: Default Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Name: admin Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Role: reader,member,admin Aug 31 06:55:13.238253 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Roles: reader,member,admin Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_401290fcd7dc4e5b872551b994bb6482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant: admin Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant-Name: admin Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User: admin Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Domain-Id: default Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Domain-Name: Default Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Id: 6efabcfc41f2493bb1abf0c2d7f42d8c Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Name: admin Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: method: > Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: exception: Flavor 84 could not be found. Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: action_args: {'id': '84'} Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 06:55:13.239750 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:13.240611 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.241684 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-022a748d-03d6-44bc-9ccd-ba3044313a65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 06:55:13.242703 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-022a748d-03d6-44bc-9ccd-ba3044313a65 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.430989 Aug 31 06:55:13.242703 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 06:55:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 06:55:13.249536 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-8f6a6e3d-d518-429b-ab27-34e9723946d5 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:13.265949 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-8f6a6e3d-d518-429b-ab27-34e9723946d5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019863 Aug 31 06:55:13.266645 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 06:55:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:55:13.276249 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-efe28449-8079-4ae5-994a-ecaa333b9fb4 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:13.292288 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-efe28449-8079-4ae5-994a-ecaa333b9fb4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019597 Aug 31 06:55:13.292843 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 06:55:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:55:13.305105 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c00966cc-3135-4280-b58d-eaba805fbe5d admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:13.313775 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-c00966cc-3135-4280-b58d-eaba805fbe5d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c00966cc-3135-4280-b58d-eaba805fbe5d admin admin] Request method failure captured: Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Accept: application/json Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Connection: keep-alive Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Content-Length: 0 Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Host: 10.222.0.42 Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.90 Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjDwXQ8BmBaS2qlpr66trbQ1cawSCEFp87S4Cpy4iqa_E04rq76RoH3QOfQ1oTxkLhChsZcY68bltXaqSZghmogmGZOs6E6mcQdWboOg9gtWVfRHZ86CGFoSfxDXalcyl5EuJb_V5vLxnq_Iuwc5Joxt0CT7QpMhbYBqG_tzz1I-nnLas Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Role: reader,member,admin Aug 31 06:55:13.316067 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Roles: reader,member,admin Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_401290fcd7dc4e5b872551b994bb6482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant: admin Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User: admin Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Id: 6efabcfc41f2493bb1abf0c2d7f42d8c Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Name: admin Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: method: > Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: exception: Flavor 84 could not be found. Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: action_args: {'id': '84'} Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 06:55:13.317774 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:13.318892 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:13.320336 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c00966cc-3135-4280-b58d-eaba805fbe5d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 06:55:13.321592 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-c00966cc-3135-4280-b58d-eaba805fbe5d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.018341 Aug 31 06:55:13.321592 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 06:55:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 06:55:14.296828 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-efe28449-8079-4ae5-994a-ecaa333b9fb4 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:14.297841 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-efe28449-8079-4ae5-994a-ecaa333b9fb4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 31 06:55:14.298258 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:14.850376 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-124b6cbe-4136-4bea-936b-2db6783bfb1a admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:14.856389 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-124b6cbe-4136-4bea-936b-2db6783bfb1a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-124b6cbe-4136-4bea-936b-2db6783bfb1a admin admin] Request method failure captured: Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Accept: application/json Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Connection: keep-alive Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Content-Length: 0 Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Host: 10.222.0.42 Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.90 Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjDwXSDgjnUBvN4g_0lIWQD7gIuW_xBG5y4Wr6DJ9YzhOL0zWW04H482EiD-m6ag5sInfDga2HWVCUy606SvuMELW8MfN_Yy7Mwm4lMxrxbw6NwTW0z11Gm4PPY1dC2nogXexuJRLnsbuvzBuNmzFwAyZONTgTqUFNCqcL_Qz3CnXpGLM Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Role: reader,member,admin Aug 31 06:55:14.857894 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Roles: reader,member,admin Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_401290fcd7dc4e5b872551b994bb6482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant: admin Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User: admin Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Id: 6efabcfc41f2493bb1abf0c2d7f42d8c Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: X-User-Name: admin Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: method: > Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: exception: Flavor 451 could not be found. Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: action_args: {'id': '451'} Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 06:55:14.859591 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:14.861010 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.862906 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-124b6cbe-4136-4bea-936b-2db6783bfb1a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 06:55:14.864192 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-124b6cbe-4136-4bea-936b-2db6783bfb1a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.418604 Aug 31 06:55:14.864192 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 06:55:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 06:55:14.870286 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-7c38862c-e70d-46f3-a482-b4a6d057133e admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:14.888377 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-7c38862c-e70d-46f3-a482-b4a6d057133e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022549 Aug 31 06:55:14.888955 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 06:55:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:55:14.899712 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:14.922188 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025961 Aug 31 06:55:14.922702 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 06:55:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:55:14.934463 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-d924133d-8160-448b-8088-933c4fa3d611 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:14.941310 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.wsgi [None req-d924133d-8160-448b-8088-933c4fa3d611 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-d924133d-8160-448b-8088-933c4fa3d611 admin admin] Request method failure captured: Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Accept: application/json Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Accept-Encoding: gzip, deflate Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Connection: keep-alive Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Content-Length: 0 Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Host: 10.222.0.42 Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Openstack-Api-Version: compute 2.90 Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Openstack-System-Scope: None Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: User-Agent: python-novaclient Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Auth-Token: gAAAAABjDwXSDgjnUBvN4g_0lIWQD7gIuW_xBG5y4Wr6DJ9YzhOL0zWW04H482EiD-m6ag5sInfDga2HWVCUy606SvuMELW8MfN_Yy7Mwm4lMxrxbw6NwTW0z11Gm4PPY1dC2nogXexuJRLnsbuvzBuNmzFwAyZONTgTqUFNCqcL_Qz3CnXpGLM Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Domain-Id: None Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Domain-Name: None Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Identity-Status: Confirmed Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Is-Admin-Project: True Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Domain-Id: default Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Domain-Name: Default Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Project-Name: admin Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Role: reader,member,admin Aug 31 06:55:14.943672 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Roles: reader,member,admin Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_401290fcd7dc4e5b872551b994bb6482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/401290fcd7dc4e5b872551b994bb6482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant: admin Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant-Id: 401290fcd7dc4e5b872551b994bb6482 Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-Tenant-Name: admin Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User: admin Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Domain-Id: default Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Domain-Name: Default Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Id: 6efabcfc41f2493bb1abf0c2d7f42d8c Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: X-User-Name: admin Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: method: > Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: exception: Flavor 451 could not be found. Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: action_args: {'id': '451'} Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 06:55:14.945152 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:14.946021 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Aug 31 06:55:14.947128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-d924133d-8160-448b-8088-933c4fa3d611 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 06:55:14.948160 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-d924133d-8160-448b-8088-933c4fa3d611 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016090 Aug 31 06:55:14.948160 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 06:55:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 06:55:15.941167 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:15.942190 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 06:55:15.942589 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:16.510898 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f94139d4-0737-441d-bd7a-52b42a9f5cf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:55:16.538552 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f94139d4-0737-441d-bd7a-52b42a9f5cf9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.450377 Aug 31 06:55:16.539092 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 06:55:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:55:17.537406 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:17.538922 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Aug 31 06:55:17.539470 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:18.105507 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-6df9f064-6bb8-4261-9273-df0c0096c996 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:55:18.131783 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-6df9f064-6bb8-4261-9273-df0c0096c996 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.445963 Aug 31 06:55:18.132323 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 06:55:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:55:19.121020 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:19.122039 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 31 06:55:19.122420 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:19.830457 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-6e4cb1f5-1b43-448a-bc99-9925ef596652 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:55:19.852337 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-6e4cb1f5-1b43-448a-bc99-9925ef596652 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.587019 Aug 31 06:55:19.852878 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 06:55:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:55:20.830666 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:20.831711 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 31 06:55:20.832104 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:21.384172 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8125b68b-72eb-4fbb-a694-31a1b47a982e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 06:55:21.404918 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-8125b68b-72eb-4fbb-a694-31a1b47a982e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.435818 Aug 31 06:55:21.405458 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 06:55:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:55:22.397124 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:22.398141 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 31 06:55:22.398534 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:55:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:55:22.961695 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e0c02683-f735-498b-b6c2-c3fb59847ca0 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:55:22.991736 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e0c02683-f735-498b-b6c2-c3fb59847ca0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.457227 Aug 31 06:55:22.992300 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Aug 31 06:55:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:56:16.964732 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:56:16.966387 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-846ca334-1f05-4aee-b10b-30cde516200b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002273 Aug 31 06:56:16.967068 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 06:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:56:16.984400 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:56:17.423683 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f6f8ad12-8aa7-41ed-b299-4d814d96ea34 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:56:17.444583 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f6f8ad12-8aa7-41ed-b299-4d814d96ea34 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.467781 Aug 31 06:56:17.445128 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 06:56:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:56:17.474390 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=14 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:56:17.478114 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-59be8a7d-ac37-4f15-861b-0c7c6cf6da4b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:56:17.486192 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-59be8a7d-ac37-4f15-861b-0c7c6cf6da4b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013131 Aug 31 06:56:17.486933 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 31 06:56:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:56:17.498764 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e3b8c8ad-dc38-4dd8-a3c6-c4c0752c921c admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:56:17.506819 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e3b8c8ad-dc38-4dd8-a3c6-c4c0752c921c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011704 Aug 31 06:56:17.507388 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 31 06:56:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:56:17.518652 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:56:17.526201 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011092 Aug 31 06:56:17.526714 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 31 06:56:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 06:56:17.538752 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-ec4e0db8-f1d0-4ece-91ec-f702ff5290b7 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:56:17.546466 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-ec4e0db8-f1d0-4ece-91ec-f702ff5290b7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011250 Aug 31 06:56:17.547002 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 31 06:56:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 06:59:13.399988 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:13.400995 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 31 06:59:13.401359 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:59:13.541155 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=6 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:59:13.715696 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:13.719092 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:13.719573 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:13.719993 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:13.720697 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:13.721140 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:13.721550 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:13.755922 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-34771e4b-cf7a-4948-a5c9-8088ddad811c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216137 Aug 31 06:59:13.756488 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 06:59:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 06:59:14.605365 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:14.606370 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 06:59:14.606762 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:59:14.801192 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:14.804700 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:14.805108 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:14.805526 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:14.806228 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:14.806664 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:14.807102 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:14.826693 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-0812001b-d7c1-4d4b-9cde-9baa461c4fbd admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082314 Aug 31 06:59:14.827269 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 06:59:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 06:59:26.119206 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:26.120220 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 31 06:59:26.120613 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:59:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:59:26.263645 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell0:SELECT=4 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:59:26.264372 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell1:SELECT=4 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:59:26.265005 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=8 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 06:59:26.318490 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:26.323656 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:26.324342 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:26.324955 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:26.325980 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:26.326558 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:26.327170 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:26.353621 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-b7b45d8e-9a3b-4ce3-987a-3e764f049acd admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.094564 Aug 31 06:59:26.354167 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 06:59:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 06:59:27.196154 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:27.197454 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-d2644dce-9ec5-49b5-8e5b-730357d5d06f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Aug 31 06:59:27.197970 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 06:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 06:59:27.397695 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 06:59:27.402530 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:27.403220 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:27.403825 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:27.404894 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 06:59:27.405486 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 06:59:27.406012 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 06:59:27.429446 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-3488cd9f-194c-495d-a501-ef6cdca1a04f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091709 Aug 31 06:59:27.430003 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 06:59:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:00:22.115792 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: Wed Aug 31 07:00:22 2022 - graceful shutdown triggered... Aug 31 07:00:22.116353 dv-cinder-855288-3-iscsi devstack@n-api.service[105588]: Gracefully killing worker 2 (pid: 105588)... Aug 31 07:00:22.115876 dv-cinder-855288-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 07:00:22.117158 dv-cinder-855288-3-iscsi devstack@n-api.service[105587]: Gracefully killing worker 1 (pid: 105587)... Aug 31 07:00:23.117039 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: worker 1 buried after 1 seconds Aug 31 07:00:23.117039 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: worker 2 buried after 1 seconds Aug 31 07:00:23.117039 dv-cinder-855288-3-iscsi devstack@n-api.service[105586]: goodbye to uWSGI. Aug 31 07:00:23.118771 dv-cinder-855288-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 07:00:23.119392 dv-cinder-855288-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 07:00:23.122390 dv-cinder-855288-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 07:00:23.132465 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 07:00:23 2022] *** Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: nodename: dv-cinder-855288-3-iscsi Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: machine: x86_64 Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: clock source: unix Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: pcre jit disabled Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: detected number of CPU cores: 4 Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: current working directory: / Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: detected binary path: /usr/bin/uwsgi-core Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: your processes number limit is 47680 Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: your memory page size is 4096 bytes Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: detected max file descriptor number: 2048 Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: lock engine: pthread robust mutexes Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: thunder lock: enabled Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 07:00:23.135140 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 07:00:23.182120 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: Python main interpreter initialized at 0x56342a6489c0 Aug 31 07:00:23.182120 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: python threads support enabled Aug 31 07:00:23.182120 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: your server socket listen backlog is limited to 100 connections Aug 31 07:00:23.182120 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: your mercy for graceful operations on workers is 90 seconds Aug 31 07:00:23.182611 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 07:00:23.182611 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: *** Operational MODE: preforking *** Aug 31 07:00:23.183069 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: *** uWSGI is running in multiple interpreter mode *** Aug 31 07:00:23.183069 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: spawned uWSGI master process (pid: 120751) Aug 31 07:00:23.183105 dv-cinder-855288-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 07:00:23.183697 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: spawned uWSGI worker 1 (pid: 120770, cores: 1) Aug 31 07:00:23.185263 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: spawned uWSGI worker 2 (pid: 120771, cores: 1) Aug 31 07:00:23.187436 dv-cinder-855288-3-iscsi devstack@n-api.service[120751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 07:00:23.850983 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 07:00:23.858149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 07:00:25.005722 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 07:00:25.005722 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: from cryptography.utils import int_from_bytes Aug 31 07:00:25.006479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 07:00:25.006479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: from cryptography.utils import int_from_bytes Aug 31 07:00:25.007132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 07:00:25.007132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: from cryptography.utils import int_from_bytes Aug 31 07:00:25.007296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 07:00:25.007296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: from cryptography.utils import int_from_bytes Aug 31 07:00:27.381002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 07:00:27.381719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 07:00:27.381813 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 07:00:27.382154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 07:00:27.382400 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 07:00:27.382789 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.383145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.383462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.383780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.384235 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.384562 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.384899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.385217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.385543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.385802 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.386105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.386426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-3-iscsi {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.386746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.387079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.387385 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.387815 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.388117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.388447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.388768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.389270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.389704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.390013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.390319 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.390659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.390995 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.391302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.391623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.391926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.392249 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.392554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.392958 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-3-iscsi {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.393268 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.393581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.393887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.394299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.394606 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.395018 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.395347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.395652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.395958 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.396294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.396612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.396931 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.397254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.397544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.397848 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.398155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.398471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.398584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 07:00:27.399080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.399180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 07:00:27.399282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.399368 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 07:00:27.399451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.399592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.399691 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 07:00:27.399913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.400036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 07:00:27.400228 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.400321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.400547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.400693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.400835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.400969 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.401097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.401234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.401330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.401634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.401731 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.401938 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.402038 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.402241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.402339 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.402543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.402647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.402866 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.402976 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.403200 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.403310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.403519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.403643 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.403911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.404011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-3-iscsi {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.404220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.404363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.404539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.404638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.404859 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.404962 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.405180 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.405280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.405484 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.405585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.405801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.405957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.406106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.406198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.406433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.406637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.406746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.406971 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.407102 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.407279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.407407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.407590 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.407708 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.407931 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.412164 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.412338 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.412499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.412649 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.412855 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.412999 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.413157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.413309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.413459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.413459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.413745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.413745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.414039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.414039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.414325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-3-iscsi {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.414475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.414628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.414785 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.414971 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.415123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.415275 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.415421 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.415563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.415715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.415869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.416028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.416170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.416321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.416321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.416611 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.416752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.416900 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.417053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.417201 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.417358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.417499 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.417639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.417790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.417950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.418104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.418259 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.418401 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.418556 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.418705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.418956 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.419122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.419284 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.419426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.419573 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.419722 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.419871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.420039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.420193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.420341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.420490 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.420638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.420787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.420942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.421086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.421227 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.421380 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.421532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.421674 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.421824 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.421970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.422122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.422122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.422416 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.422564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.422717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.422920 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.423083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.423234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.423234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.423518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.423682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.423832 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.424042 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.424195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.424337 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.424488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.424628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.424775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.424924 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.425078 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.425220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.425371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.425519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.425685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.425834 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.425975 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.426123 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.426266 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.426412 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.426568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.426568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.426867 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.427024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.427166 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.427323 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.427485 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.427628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.427780 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.427922 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.428061 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.428209 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.428360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.428508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.428656 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.428797 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.428945 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.429105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.429256 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.429417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.429624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.429778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.429919 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.430071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.430218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.430360 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.430502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.430651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.430793 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.431070 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.431215 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.431215 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.431512 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.431663 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.431812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.431961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.432103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.432251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.432403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.432552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.432706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.432848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.432995 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.433152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.433305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.433445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.433610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.433753 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.433893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.434042 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.434190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.434330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.434480 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.434651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.434805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.434983 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.435127 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.435279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.435429 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.435570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.435720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.435869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.436020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.436176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.436318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.436466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.436607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.436748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.436897 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.437053 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.437205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.437346 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.437498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.437647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.437799 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.437954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.438109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.438250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.438404 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.438552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.438700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.438885 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.439052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.439214 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.439370 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.439512 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.439660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.439801 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.439943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.440083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.440232 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.440384 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.440535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.440683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.440830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.440997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.440997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.441265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.441406 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.441545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.441685 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.441838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.441987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.442130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.442278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.442427 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.442574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.442730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.442937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.443087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.443237 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.443379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.443532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.443680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.443836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.443985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.444136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.444285 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.444434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.444583 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.444737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.444889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.445043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.445193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.445342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.445484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.445639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.445781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.445928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.446070 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.446218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 07:00:27.446369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.446511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.446660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.446660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.446986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.447130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.447284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.447433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.447586 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.447735 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.447877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.448028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.448184 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.448327 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.448467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.448625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.448773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.449007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.449163 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.449307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.449448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.449597 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.449739 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.449889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.450037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.450251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.450393 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.450699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.450883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.451050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.451194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.451343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.451485 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.451633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.451782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.451940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.452081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.452224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.452372 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.452515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.452668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.452821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.452968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.453121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.453269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.453417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.453582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.453725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.453872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.454016 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.454164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.454305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.454460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.454615 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.454757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.454941 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.455100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.455251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.455408 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.455559 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.455701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.455841 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.455979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.456128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.456269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.456409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.456559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.456701 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.456848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.456998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.457149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.457302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.457443 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.457583 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.457732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.457884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.457884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.458168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.458310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.458462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.458612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.458764 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.458927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.459074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.459225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.459378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.459535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.459683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.459837 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.459985 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.460126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.460274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.460439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.460588 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.460731 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.460871 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.461011 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.461151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.461301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.461443 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.461584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.461724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.461871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.462020 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.462186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.462328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.462477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.462618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.462766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.462953 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.463147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.463289 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.463429 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.463577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.463718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.463874 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.464024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.464175 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.464316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.464464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.464613 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.464769 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.464911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.465051 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.465200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.465349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.465499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.465705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.465858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.466007 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.466170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.466322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.466465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.466616 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.466758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.466917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.467064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.467218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.467376 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.467526 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.467668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.467817 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.467968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.468132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.468289 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.468438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.468580 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.468728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.468879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.469028 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.469192 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.469338 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.469486 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.469627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.469627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.469949 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.470123 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.470275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.470275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.470541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.470681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.470831 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.471037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.471188 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.471346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.471488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.471630 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.471780 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.471940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.472081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.472221 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.472370 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.472511 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.472662 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.472804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.472952 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.473094 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.473233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.473373 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.473524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.473666 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.473823 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.473973 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.474122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.474271 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.474421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.474564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.474712 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.474879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.475036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.475193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.475334 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.475475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.475624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.475784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.475925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.476075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.476230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.476373 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.476513 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.476662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.476848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.477076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.477228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.477378 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.477520 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.477671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.477832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.477976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.478116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.478264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.478405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.478554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.478707 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.478906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.479054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.479216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.479216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.479502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.479663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.479806 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.479946 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.480086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.480236 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.480377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.480531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.480681 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.480823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.480964 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.481112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.481302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.481487 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.481640 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.481789 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.481943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.482086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.482241 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.482400 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.482542 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.482682 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.482828 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.483007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.483165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.483316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.483458 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.483619 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.483769 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.483913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.484069 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.484220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.484361 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.484502 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.484641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.484790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.484941 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.485090 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.485238 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.485389 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.485547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.485699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.485846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.485846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.486123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.486273 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.486415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.486564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.486713 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.486880 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.487027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.487169 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.487321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.487486 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.487628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.487768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.487909 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.488057 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.488199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.488349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.488499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.488640 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.488780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.488920 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.489075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.489237 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.489388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.489536 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.489686 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.489835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.489990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.490138 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.490138 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.490424 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.490566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.490714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.490714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.491063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.491063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.491363 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.491503 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.491644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.491795 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.491945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.492094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.492253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.492395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.492535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.492674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.492814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.492962 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.493126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.493275 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.493417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.493556 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.493696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.493836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.493991 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.494132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.494280 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.494423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.494571 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.494719 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.494893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.495064 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.495214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.495361 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.495503 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.495653 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.495794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.495794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.496104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.496247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.496395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.496547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.496695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.496847 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.497036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.497187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.497336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.497488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.497638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.497779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.497930 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.498080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.498231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.498380 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.498521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.498671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.498827 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.499040 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.499238 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.499386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.499528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.499671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.499812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.499954 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.500110 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.500253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.500403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.500552 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.500695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.500854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.501010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.501159 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.501300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.501441 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.501581 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.501738 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.501880 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.502029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.502178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.502319 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.502469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.502626 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.502778 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.502953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.503106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.503247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.503396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.503547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.503698 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.503848 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.503989 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.504130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.504270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.504420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.504579 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.504731 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.504873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.505014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.505168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.505318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.505460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.505602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.505750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.505892 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.506116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.506268 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.506410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.506579 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.506721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.506938 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.506938 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.507250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.507399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.507546 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.507702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.507850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.508007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.508165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.508321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.508477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.508644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.508644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.508950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.509108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.509280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.509438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.509594 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.509756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.509905 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.510052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.510199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.510361 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.510518 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.510687 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.510836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.511019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.511179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.511338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.511486 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.511635 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.511782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.511937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.512165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.512317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.512463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.512752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.512959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.513112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.513276 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.513426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.513582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.513732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.513889 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.514046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.514205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.514363 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.514519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.514675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.514867 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.515041 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.515192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.515341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.515489 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.515639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.515796 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.515955 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.516114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.516264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.516412 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.516560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.516708 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.516882 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.517039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.517188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.517344 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.517495 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.517651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.517809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.517957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.518114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.518262 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.518417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.518579 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.518736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.518961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.519125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.519291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.519449 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.519613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.519769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.519923 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.520079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.520227 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.520374 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.520531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.520680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.520846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.521002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.521151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.521307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.521464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.521612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.521768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.521924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.522072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.522229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.522385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.522533 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.522680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.522864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.523019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.523183 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.523342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.523490 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.523646 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.523795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.523942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.524105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.524262 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.524424 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.524580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.524735 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.524904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.525063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.525219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.525375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.525523 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.525678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.525840 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.525998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.526157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.526306 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.526461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.526617 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.526779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.526962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.527123 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.527275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.527422 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.527569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.527726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.527884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.528033 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.528254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.528479 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.528642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.528805 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.528964 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.529132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.529292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.529448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.529611 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.529768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.529925 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.530083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.530231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.530378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.530534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.530682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.530838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.531060 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.531211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.531369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.531532 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.531680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.531828 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.531982 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.532140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.532296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.532454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.532602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.532602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.532891 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.533056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.533215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.533363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.533510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.533664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.533812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.533958 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.534120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.534120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.534408 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.534556 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.534703 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.534896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.535074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.535225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.535381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.535537 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.535693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.535849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.536367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.536520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.536675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.536830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.536978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.537152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.537308 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.537476 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.537633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.537780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.537927 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.538088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.538236 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.538391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.538547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.538704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.538955 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.539138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.539296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.539462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.539619 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.539775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.539929 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.540088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.540243 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.540391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.540547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.540695 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.540856 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.541005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.541151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.541307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.541477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.541477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.541841 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.542000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.542155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.542303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.542458 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.542614 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.542772 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.542945 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.543106 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.543262 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.543419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.543419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.543720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.543925 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.544075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.544229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.544378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.544378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.544681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.544837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.544985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.545140 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.545298 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.545455 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.545623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.545781 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.545945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.546095 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.546243 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.546400 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.546550 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.546696 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.546917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.547084 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.547234 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.547396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.547562 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.547711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.547869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.548016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.548177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.548325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.548481 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.548628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.548784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.548942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.549110 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.549259 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.549407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.549564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.549712 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.549867 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550174 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.550980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.551289 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.551492 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.551675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.551834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.551992 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.552141 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.552289 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.552437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.552593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.552743 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.552897 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.553046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.553194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.553341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.553498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.553657 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.553813 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.553962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.554109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.554267 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.554423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.554571 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.554718 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.554906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.555073 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.555240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.555390 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.555550 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.555705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.555854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.556001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.556158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.556318 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.556468 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.556623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.556780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.556936 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.557094 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.557243 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.557392 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.557549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.557699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.557860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.558009 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.558164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.558312 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.558460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.558608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.558769 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.558950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.559118 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.559275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.559275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.559606 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.559771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.559928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.560085 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.560234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.560453 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.560619 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.560779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.560935 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.561084 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.561231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.561388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.561564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.561714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.561870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.562026 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.562182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.562331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.562492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.562642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.562798 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.563005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.563164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.563321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.563549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.563724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.563873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.564022 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.564178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.564335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.564498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.564648 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.564804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.564961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.565109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.565273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.565273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.565565 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.565734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.565883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566349 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566504 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566818 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.566952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.567086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.567214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.567340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.567473 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.567598 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.567740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.567869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568269 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568542 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.568942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.569205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.569340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.569466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.569601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.569727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.569859 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.569999 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.570126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.570252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.570377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.570502 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.570633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.570769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.570910 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571054 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571447 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.571849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.572714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573663 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.573788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.574710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.575809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.575934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.576076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.576076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.576323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.576463 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.576597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.576723 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.576886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.577093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.577224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.577494 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.577624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.577821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.578125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.578260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.578430 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.578740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.579092 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.579361 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.579505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.579700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.579887 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.580019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.580294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.580423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.580612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.580868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.581012 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.581312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.581520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.581762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.581899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.582169 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.582298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.582496 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.582741 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.582937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.583152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.583295 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.583460 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.583724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.583854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.584077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.584205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.584381 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.584609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.584749 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.584984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.585113 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.585286 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.585500 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.585641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.585886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.586022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.586192 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.586376 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.586515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.586784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.586970 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.587190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.587409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.587553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.587804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.587983 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.588123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.588394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.588532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.588703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.589004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.589304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.589584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.589724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.589890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.590076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.590215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.590483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.590638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.590897 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.591128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.591271 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.591497 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.591625 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.591797 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.592038 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.592182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.592438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.592574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.592761 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.592950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.593103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.593362 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.593501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.593662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.593852 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.593984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.594273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.594410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.594582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.594761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.594918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.595217 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.595347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.595574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.595704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.596065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.596194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.596435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.596573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.596754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.596957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.597087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.597400 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.597528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.597706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.597876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.598015 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.598299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.598620 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.598953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.599263 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.599409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.599539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.599849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.600097 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.600242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.600445 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.600619 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.600764 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.601041 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.601171 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.601346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.601519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.601650 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.601938 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.602068 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.602245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.602437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.602568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.602836 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.602984 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.603185 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.603355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.603527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.603789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.603920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.604143 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.604279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.604456 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.604708 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.604838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.605055 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.605192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.605360 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.605620 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.605752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.605961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.606101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.606338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.606571 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.606717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.606992 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.607184 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.607315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.607618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.607768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.608004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.608133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.608316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.608634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.608764 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.608944 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.609263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.609586 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.609810 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.609941 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.610201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.610330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.610507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.610741 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.610906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.611194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.611339 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.611519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.611676 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.611843 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.612122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.612252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.612435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.612599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.612728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.613029 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.613158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.613342 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.613505 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.613636 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.613932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.614071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.614230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.614537 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.614673 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.614839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.615052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.615194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.615458 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.615600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.615765 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.615955 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.616087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.616355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.616498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.616655 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.616886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.617024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.617242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.617372 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.618077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.618211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.618339 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.618475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.618602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.618602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.618941 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.619070 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.619304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.619594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.619921 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.620106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.620239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.620550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.620694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.620869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.621092 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.621229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.621486 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.621612 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.621796 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.622189 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.622322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.622584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.622710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.623072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.623219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.623395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.623570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.623728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.624011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.624154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.624332 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.624469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.624641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.624899 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.625036 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.625240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.625377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.625546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.625777 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.625913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.626186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.626323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.626488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.626691 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.626827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.627137 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.627279 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.627456 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.627624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.627753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.628048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.628177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.628388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.628665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.628971 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.629277 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.629425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.629661 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.629886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.630198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.630398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.630752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.630910 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.631139 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.631291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.631454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.631656 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.631795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.632085 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.632234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.632372 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.632571 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.632711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.632955 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.633089 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.633325 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.633456 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.633634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.633768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.633966 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.634105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.634287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.634417 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.634597 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.634737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.634934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.635083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.635224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.635351 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.635485 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 07:00:27.635628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.635823 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.636135 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.636444 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.636748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.637078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.637385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.637718 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.638176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.638532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.638858 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.639196 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.639638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.639972 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.640411 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.640725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.641065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.641373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.641688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.641995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.642307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.642668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.643027 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.643337 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.643665 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.643987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.644296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.644616 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.644932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.645244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.645592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.645911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.646465 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.646797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.647149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.647485 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.647816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.648125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.648431 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.648736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.649354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.649693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.650009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.650388 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.650684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.651021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.651331 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.651641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.651950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.652258 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.652565 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.652874 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.653245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.653556 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.653866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.654180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.654520 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.654904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.655224 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.655589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.655902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.656217 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.656528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.656833 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.657139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.657451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.657778 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.658088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.658392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.658821 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.659155 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.659473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.661380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.661380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.661380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.661380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.661380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.662023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.662300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.662637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.663753 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.663753 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.663753 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.664129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.664246 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.664645 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.665137 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.665715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.666030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.666423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.666975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.667331 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.667779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.668270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.668605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.669052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.669571 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.669946 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.670300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.670608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.670938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.671253 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.671542 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.671854 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.672160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.672465 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.672767 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.673071 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.673372 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.673706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.674039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.674354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.674675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.675009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.675336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.675647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.675970 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.676297 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.676623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.676929 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.677263 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.677574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.677886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.678198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.678507 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.678815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.679146 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.679475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.679803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.680111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.680436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.680755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.681072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.681385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.681692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.682019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.682330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.682639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.683042 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.683418 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.683734 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.684050 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.684360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.684730 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.685047 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.685362 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.685690 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.686014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.686321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.686651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.687000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.687354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.687668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.688013 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.688341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.688661 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.689020 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.689297 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 07:00:27.689540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 07:00:27.697009 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO dbcounter [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Registered counter for database nova_api Aug 31 07:00:27.717802 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_db.sqlalchemy.engines [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:27.724945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writer thread running {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:27.750892 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO dbcounter [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Registered counter for database nova_api Aug 31 07:00:27.771290 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_db.sqlalchemy.engines [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:27.778053 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writer thread running {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:27.779907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.context [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9bb752fc-b4d8-4d43-a046-f1c835bf074d(cell1) {{(pid=120770) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 07:00:27.783970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:00:27.784444 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:00:27.786364 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:00:27.787128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:00:27.787565 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:00:27.789558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:00:27.791575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO dbcounter [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Registered counter for database nova_cell0 Aug 31 07:00:27.796004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO dbcounter [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Registered counter for database nova_cell1 Aug 31 07:00:27.804233 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_db.sqlalchemy.engines [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:27.804984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_db.sqlalchemy.engines [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:27.811259 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writer thread running {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:27.813765 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writer thread running {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:27.836572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.context [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9bb752fc-b4d8-4d43-a046-f1c835bf074d(cell1) {{(pid=120771) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 07:00:27.841475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:00:27.841935 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:00:27.843550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:00:27.844276 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:00:27.844720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:00:27.846715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:00:27.848739 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO dbcounter [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Registered counter for database nova_cell0 Aug 31 07:00:27.853028 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO dbcounter [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Registered counter for database nova_cell1 Aug 31 07:00:27.861166 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_db.sqlalchemy.engines [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:27.862634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_db.sqlalchemy.engines [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:27.867221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writer thread running {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:27.959417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO dbcounter [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Registered counter for database nova_cell0 Aug 31 07:00:27.966749 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_db.sqlalchemy.engines [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:27.971744 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writer thread running {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:28.011119 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writer thread running {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:28.021484 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO dbcounter [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Registered counter for database nova_cell0 Aug 31 07:00:28.028532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_db.sqlalchemy.engines [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 07:00:28.033456 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writer thread running {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 07:00:28.285985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: WARNING keystonemiddleware.auth_token [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 07:00:28.293603 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: WARNING keystonemiddleware.auth_token [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 07:00:28.350700 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: WARNING keystonemiddleware.auth_token [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 07:00:28.358507 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: WARNING keystonemiddleware.auth_token [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 07:00:28.638997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: WARNING keystonemiddleware.auth_token [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 07:00:28.645049 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: WARNING keystonemiddleware.auth_token [None req-8989f801-a711-4c8a-883a-0104cd9bdc29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 07:00:28.650403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56342a6489c0 pid: 120770 (default app) Aug 31 07:00:28.711190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: WARNING keystonemiddleware.auth_token [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 07:00:28.717329 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: WARNING keystonemiddleware.auth_token [None req-e942d9f2-b2ea-43db-8672-e927edb6a75e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 07:00:28.722648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56342a6489c0 pid: 120771 (default app) Aug 31 07:01:05.357671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=3 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:05.358819 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=3 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:05.359635 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=3 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:05.360776 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=3 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:07.449062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a55eb5a7-b44c-44c8-bef5-ca5c67b59fd1 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Action: 'create', calling method: .version_select at 0x7ff9c168ae50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1250213726"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:10.369739 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a55eb5a7-b44c-44c8-bef5-ca5c67b59fd1 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 5.026364 Aug 31 07:01:10.373035 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Aug 31 07:01:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 5031 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 31 07:01:10.388058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:10.388917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:10.389735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:10.397763 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:10.777474 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ac15bc9d-7d17-45e5-8d6c-70ed3ccf4c5f tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1687a60>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:11.462048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ac15bc9d-7d17-45e5-8d6c-70ed3ccf4c5f tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5" status: 200 len: 346 microversion: 2.1 time: 1.079879 Aug 31 07:01:11.473962 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:01:10 2022] GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 => generated 346 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:11.478379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-272ae47e-4bb9-42c3-9225-eec596e68707 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Action: 'create', calling method: .version_select at 0x7ff9c1504c10>, body: {"snapshot": {"volume_id": "fe3126aa-f5c4-4dca-a6cf-5416de9e12f5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1011903679"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:12.192087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-272ae47e-4bb9-42c3-9225-eec596e68707 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.718019 Aug 31 07:01:12.193359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Aug 31 07:01:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:12.204869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e994aec7-5e33-4a31-be4d-f937e910dd01 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c154cca0>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:12.333449 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e994aec7-5e33-4a31-be4d-f937e910dd01 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 200 len: 287 microversion: 2.1 time: 0.133037 Aug 31 07:01:12.339909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 07:01:12 2022] GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:12.350594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d59698bd-ee58-4350-a130-52f812930415 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1525dc0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:12.463743 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d59698bd-ee58-4350-a130-52f812930415 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.122002 Aug 31 07:01:12.464332 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 31 07:01:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:12.476030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ddfc20fe-7eb4-4632-b791-f3a4255509b6 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1507430>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:12.609049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ddfc20fe-7eb4-4632-b791-f3a4255509b6 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 200 len: 287 microversion: 2.1 time: 0.136953 Aug 31 07:01:12.610047 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 07:01:12 2022] GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:13.622210 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fd8a3fe9-46c5-4574-8edd-2f17591b1859 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1525af0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:13.680592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fd8a3fe9-46c5-4574-8edd-2f17591b1859 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 200 len: 287 microversion: 2.1 time: 0.062163 Aug 31 07:01:13.685476 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 07:01:13 2022] GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:14.693265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4fb39b0e-62cc-4edd-ba57-40950361a135 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1507af0>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:14.775166 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4fb39b0e-62cc-4edd-ba57-40950361a135 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 200 len: 287 microversion: 2.1 time: 0.085577 Aug 31 07:01:14.776551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 07:01:14 2022] GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:15.177555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-686264d6-987e-4cda-8936-ac19a228aaf9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'create', calling method: .version_select at 0x7ff9c15255e0>, body: {"keypair": {"name": "tempest-keypair-812395627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcS1idHgBsKfETYH/dQxEKmEjWoBBkDiUvOk7hIy3zI/IUPuCM0oTiogIyPrVkxgQqCvM1GJo5HoQYowEeT4GveImF4OedfTN5RrY3SIQN+zNsCYGjbvoqrk27a3bCpuA=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:15.284017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-686264d6-987e-4cda-8936-ac19a228aaf9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:01:15.293602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-686264d6-987e-4cda-8936-ac19a228aaf9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for user c7232639661c42f59e4403c4819987d8 and project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:01:15.396849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-686264d6-987e-4cda-8936-ac19a228aaf9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.583359 Aug 31 07:01:15.399714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 5/9] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Aug 31 07:01:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 590 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 07:01:15.789508 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-eec6dc68-ef1e-4afe-bf8d-ae460756a25f tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c154cd30>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:15.846948 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-eec6dc68-ef1e-4afe-bf8d-ae460756a25f tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 200 len: 288 microversion: 2.1 time: 0.061995 Aug 31 07:01:15.847748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 07:01:15 2022] GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 288 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:15.859912 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d71e7f1a-2b99-4c33-be79-e3f74ca846de tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c14aa280>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:16.047621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d71e7f1a-2b99-4c33-be79-e3f74ca846de tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 202 len: 0 microversion: 2.1 time: 0.192473 Aug 31 07:01:16.048752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Aug 31 07:01:15 2022] DELETE /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:01:16.060823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3f871ab5-93bd-4236-a59d-69b3110194a2 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c14aa8b0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:16.139380 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3f871ab5-93bd-4236-a59d-69b3110194a2 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 200 len: 287 microversion: 2.1 time: 0.085788 Aug 31 07:01:16.140263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 07:01:16 2022] GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:16.437086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-164565425", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:16.736797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] validate_networks() for [('e985f39d-9936-4167-895a-43b855ba284c', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:01:17.155731 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1f176b1e-8085-4be7-aebe-8bb33cc8b98e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c14aaf70>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:17.208383 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-1f176b1e-8085-4be7-aebe-8bb33cc8b98e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] HTTP exception thrown: Snapshot 4bb48a01-70bb-471b-a393-4e131b7c2f16 could not be found. Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1f176b1e-8085-4be7-aebe-8bb33cc8b98e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Request method failure captured: Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 HTTP/1.1 Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwcxDIF2rSHzPIJsymNwYhxNvDP-g-xfSagHcRCwE5x08fvb2zZdCuPAI5ab--jC5qY-lIzd5iB31J8_ObFfUCh_YW0snoG4V2h9CxTus6FbNfBC6i714Y_813sCIP3kEuKr_mCuVCz9aKSn1isbIlVmbjjFMZgJfEM_a2rvbNt_lvE Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:01:17.214133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_31811efe2b954958bc1ceaf3fac8b22f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: a3fdf5e7f659437790f155e80b6163c8 Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Snapshot 4bb48a01-70bb-471b-a393-4e131b7c2f16 could not be found. Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '4bb48a01-70bb-471b-a393-4e131b7c2f16'} Aug 31 07:01:17.215384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4bb48a01-70bb-471b-a393-4e131b7c2f16 could not be found. (HTTP 404) (Request-ID: req-f9d89285-2c4a-4790-963b-ea0c58fcfff2) Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:17.216064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:01:17.216996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4bb48a01-70bb-471b-a393-4e131b7c2f16 could not be found. Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 07:01:17.220109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4bb48a01-70bb-471b-a393-4e131b7c2f16 could not be found. Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4bb48a01-70bb-471b-a393-4e131b7c2f16 could not be found. Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1f176b1e-8085-4be7-aebe-8bb33cc8b98e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Returning 404 to user: Snapshot 4bb48a01-70bb-471b-a393-4e131b7c2f16 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1f176b1e-8085-4be7-aebe-8bb33cc8b98e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16" status: 404 len: 111 microversion: 2.1 time: 0.066823 Aug 31 07:01:17.223804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 07:01:17 2022] GET /compute/v2.1/os-snapshots/4bb48a01-70bb-471b-a393-4e131b7c2f16 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:01:17.248594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-91f15dbf-a9f1-4fcb-8106-6add7065847e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1420700>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:17.443574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-91f15dbf-a9f1-4fcb-8106-6add7065847e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5" status: 202 len: 0 microversion: 2.1 time: 0.222191 Aug 31 07:01:17.447113 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 9/14] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:01:17 2022] DELETE /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:01:17.452559 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a01deaf7-75a9-4544-89f7-66be2b26129e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1420dc0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:17.551865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a01deaf7-75a9-4544-89f7-66be2b26129e tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5" status: 200 len: 345 microversion: 2.1 time: 0.103492 Aug 31 07:01:17.553005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 10/15] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:01:17 2022] GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:18.566006 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b594a422-5f33-4a1b-9e08-f69d626e5b08 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1420af0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:18.629825 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-b594a422-5f33-4a1b-9e08-f69d626e5b08 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] HTTP exception thrown: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b594a422-5f33-4a1b-9e08-f69d626e5b08 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Request method failure captured: Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 HTTP/1.1 Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwcxDIF2rSHzPIJsymNwYhxNvDP-g-xfSagHcRCwE5x08fvb2zZdCuPAI5ab--jC5qY-lIzd5iB31J8_ObFfUCh_YW0snoG4V2h9CxTus6FbNfBC6i714Y_813sCIP3kEuKr_mCuVCz9aKSn1isbIlVmbjjFMZgJfEM_a2rvbNt_lvE Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:01:18.632454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_31811efe2b954958bc1ceaf3fac8b22f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: a3fdf5e7f659437790f155e80b6163c8 Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'fe3126aa-f5c4-4dca-a6cf-5416de9e12f5'} Aug 31 07:01:18.633520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. (HTTP 404) (Request-ID: req-6c1b9909-1028-4577-906f-8c7fd4969b8d) Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.634153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:01:18.635155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 07:01:18.636067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.637027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.639069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b594a422-5f33-4a1b-9e08-f69d626e5b08 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Returning 404 to user: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:01:18.641214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b594a422-5f33-4a1b-9e08-f69d626e5b08 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5" status: 404 len: 109 microversion: 2.1 time: 0.079490 Aug 31 07:01:18.642040 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 11/16] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:01:18 2022] GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 07:01:18.676181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9488ed56-6378-489b-bcd0-240ee60c7283 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1420670>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:18.764466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-9488ed56-6378-489b-bcd0-240ee60c7283 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] HTTP exception thrown: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9488ed56-6378-489b-bcd0-240ee60c7283 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Request method failure captured: Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: DELETE /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 HTTP/1.1 Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwcxDIF2rSHzPIJsymNwYhxNvDP-g-xfSagHcRCwE5x08fvb2zZdCuPAI5ab--jC5qY-lIzd5iB31J8_ObFfUCh_YW0snoG4V2h9CxTus6FbNfBC6i714Y_813sCIP3kEuKr_mCuVCz9aKSn1isbIlVmbjjFMZgJfEM_a2rvbNt_lvE Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:01:18.768017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_31811efe2b954958bc1ceaf3fac8b22f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: a3fdf5e7f659437790f155e80b6163c8 Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'fe3126aa-f5c4-4dca-a6cf-5416de9e12f5'} Aug 31 07:01:18.769471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. (HTTP 404) (Request-ID: req-2a12eb28-7384-46c6-8b29-d25ffb16f168) Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.770181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 07:01:18.771168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 07:01:18.772053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9488ed56-6378-489b-bcd0-240ee60c7283 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Returning 404 to user: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-9488ed56-6378-489b-bcd0-240ee60c7283 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5" status: 404 len: 109 microversion: 2.1 time: 0.103507 Aug 31 07:01:18.772990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 12/17] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:01:18 2022] DELETE /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:01:18.779841 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-933f0803-d529-41e5-8a54-33a9ced8b169 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Calling method '.version_select at 0x7ff9c1420790>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:18.864879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-933f0803-d529-41e5-8a54-33a9ced8b169 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] HTTP exception thrown: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-933f0803-d529-41e5-8a54-33a9ced8b169 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Request method failure captured: Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 HTTP/1.1 Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwcxDIF2rSHzPIJsymNwYhxNvDP-g-xfSagHcRCwE5x08fvb2zZdCuPAI5ab--jC5qY-lIzd5iB31J8_ObFfUCh_YW0snoG4V2h9CxTus6FbNfBC6i714Y_813sCIP3kEuKr_mCuVCz9aKSn1isbIlVmbjjFMZgJfEM_a2rvbNt_lvE Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:01:18.866831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_31811efe2b954958bc1ceaf3fac8b22f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/31811efe2b954958bc1ceaf3fac8b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 31811efe2b954958bc1ceaf3fac8b22f Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619096565 Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: a3fdf5e7f659437790f155e80b6163c8 Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619096565-project Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'fe3126aa-f5c4-4dca-a6cf-5416de9e12f5'} Aug 31 07:01:18.868061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. (HTTP 404) (Request-ID: req-5a693f7d-1dd7-45ba-b866-5335f3077e3f) Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.868690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:01:18.869703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 07:01:18.870587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-933f0803-d529-41e5-8a54-33a9ced8b169 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] Returning 404 to user: Volume fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-933f0803-d529-41e5-8a54-33a9ced8b169 tempest-VolumesSnapshotsTestJSON-619096565 tempest-VolumesSnapshotsTestJSON-619096565-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5" status: 404 len: 109 microversion: 2.1 time: 0.092206 Aug 31 07:01:18.871525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 13/18] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:01:18 2022] GET /compute/v2.1/os-volumes/fe3126aa-f5c4-4dca-a6cf-5416de9e12f5 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:01:19.208030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:01:19.208549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:01:19.208912 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:01:19.209375 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:01:19.209848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:01:19.265908 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:19.266757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:19.268613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:19.269609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:19.273104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:19.277169 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:19.375048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for project a83fcf85c5fc44e396c97573a73f675a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:01:19.391329 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for user 8b9c07381f404ec39a06e01ff890da5e and project a83fcf85c5fc44e396c97573a73f675a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:01:19.438809 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:01:19.458270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:01:19.680227 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9024fd93-47cd-4316-bb98-c6123c57d7d1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.821067 Aug 31 07:01:19.689694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 6/19] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:01:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:01:19.710978 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a37c316c-4b45-488e-b5c9-b6ff9946341b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:19.718783 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a37c316c-4b45-488e-b5c9-b6ff9946341b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:19.862141 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a37c316c-4b45-488e-b5c9-b6ff9946341b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:19.887950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a37c316c-4b45-488e-b5c9-b6ff9946341b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1221 microversion: 2.1 time: 0.197700 Aug 31 07:01:19.889348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 14/20] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:19 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:20.457870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-661625123", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:20.607177 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] validate_networks() for [('e985f39d-9936-4167-895a-43b855ba284c', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:01:21.679407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1422609415", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "networks": [{"uuid": "6dd38b0e-8111-44de-8ff4-225ccb68fedc"}]}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:21.863985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.network.neutron [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] validate_networks() for [('6dd38b0e-8111-44de-8ff4-225ccb68fedc', None, None, None, None, None)] {{(pid=120770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:01:22.211987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:01:22.212980 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:01:22.213643 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:01:22.214195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:01:22.214748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:01:22.236987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:22.243150 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:22.243838 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:22.244876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:22.247450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:22.248070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:22.340664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for project a83fcf85c5fc44e396c97573a73f675a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:01:22.352598 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for user 8b9c07381f404ec39a06e01ff890da5e and project a83fcf85c5fc44e396c97573a73f675a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:01:22.416091 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:01:22.426617 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:01:22.582714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8ae37a7c-c764-4c7e-9958-8b0e9294c7b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.131873 Aug 31 07:01:22.591669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 7/21] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:01:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:01:22.625789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1347600534", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a30bcd85-0236-494d-bfd0-29b505e42da4"}], "security_groups": [{"name": "tempest-securitygroup--1525164945"}], "key_name": "tempest-keypair-812395627", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:23.055413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] validate_networks() for [('a30bcd85-0236-494d-bfd0-29b505e42da4', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:01:24.052572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:01:24.053192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:01:24.053614 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:01:24.054257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:01:24.054819 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:01:24.079136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:24.080477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:24.081149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:24.082254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:24.083067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:24.085040 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:24.117692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:01:24.125392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for user c7232639661c42f59e4403c4819987d8 and project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:01:24.145987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:01:24.152344 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:01:24.292132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-30514e31-32fd-4d8b-85ce-35079119425a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.698920 Aug 31 07:01:24.292694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 8/22] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 31 07:01:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 07:01:24.307160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1121ff8d-f851-4cdd-bedf-3621388242b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:24.321366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1121ff8d-f851-4cdd-bedf-3621388242b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:24.625381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1121ff8d-f851-4cdd-bedf-3621388242b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:24.666937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1121ff8d-f851-4cdd-bedf-3621388242b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1221 microversion: 2.1 time: 0.369236 Aug 31 07:01:24.667916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 9/23] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:24 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1221 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:24.695957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-374fe10a-a474-4aed-94e0-6486a3bf8876 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:24.696572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-374fe10a-a474-4aed-94e0-6486a3bf8876 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:24.896524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-374fe10a-a474-4aed-94e0-6486a3bf8876 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:24.914231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-374fe10a-a474-4aed-94e0-6486a3bf8876 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:24.932860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-374fe10a-a474-4aed-94e0-6486a3bf8876 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:24.939221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-374fe10a-a474-4aed-94e0-6486a3bf8876 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1281 microversion: 2.20 time: 0.263744 Aug 31 07:01:24.942701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 10/24] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:24 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:25.388146 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Flavor limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:01:25.388658 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Image limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:01:25.389305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Flavor pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:01:25.389907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Image pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:01:25.390553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:01:25.418418 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:25.422357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:25.444222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:25.447794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:25.448557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:25.473096 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:25.565932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Getting quotas for project e84d820464c34a30bee606e1c7f711c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:01:25.585961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Getting quotas for user 45ab0b2264a244a98f90769b266ccb3a and project e84d820464c34a30bee606e1c7f711c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:01:25.623967 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Going to run 1 instances... {{(pid=120770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:01:25.627328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:01:25.691385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:25.692609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:25.702192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:25.702690 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:25.703194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:25.704054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:25.704583 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:25.713968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:25.762248 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b411f28d-6390-40e3-8264-623a77b893ff tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.829838 Aug 31 07:01:25.771117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 15/25] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:01:25.776730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6be21b5d-1aa5-4107-8f6d-32c25d27aca5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:25.797120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6be21b5d-1aa5-4107-8f6d-32c25d27aca5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:26.138721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6be21b5d-1aa5-4107-8f6d-32c25d27aca5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:26.149540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6be21b5d-1aa5-4107-8f6d-32c25d27aca5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1215 microversion: 2.1 time: 0.376752 Aug 31 07:01:26.152273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 16/26] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:25 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1215 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:26.160335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:26.162984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:26.185365 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:26.186116 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:26.186809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:26.188455 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:26.189532 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:26.209371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:26.326918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:26.372393 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-33ae7018-0955-4ca7-a81b-202dc1bb4843 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1281 microversion: 2.1 time: 0.685269 Aug 31 07:01:26.386374 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 11/27] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:25 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1281 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:27.070080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:27.106369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:27.109027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:27.110549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-761949cb-47ea-4fa3-949e-a525e8d9d3ae tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1333 microversion: 2.20 time: 0.957064 Aug 31 07:01:27.142476 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 17/28] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:26 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1333 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:27.173628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d0a5af5d-1f58-4770-9b19-b5400438e006 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:27.174325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d0a5af5d-1f58-4770-9b19-b5400438e006 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:27.394480 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:27.395250 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:27.415932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:27.417534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:27.418953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:27.421025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:27.426024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:27.426882 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:27.710362 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d0a5af5d-1f58-4770-9b19-b5400438e006 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:27.744347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d0a5af5d-1f58-4770-9b19-b5400438e006 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1215 microversion: 2.1 time: 0.569956 Aug 31 07:01:27.745009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 12/29] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:27 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1215 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:28.131246 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:28.135544 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:28.136167 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:28.148079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7c47ec26-f062-47a4-b9bb-858c9d943fb2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1279 microversion: 2.1 time: 0.754057 Aug 31 07:01:28.152165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:28.152448 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 18/30] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:27 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1279 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:28.159480 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:28.162166 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:28.172278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:28.173071 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:28.180190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:28.623820 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:28.642973 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:28.644668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:28.645831 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-11e96de2-eb04-437b-a438-8c2bbae8f06b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1341 microversion: 2.20 time: 0.514756 Aug 31 07:01:28.646384 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 13/31] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:28 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1341 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:28.770652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:28.771497 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:28.799924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:28.803725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:28.804344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:28.805963 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:28.813536 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:28.816506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:28.986325 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:29.000764 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1d420a5a-cf3e-4450-8f91-da97afdf7a44 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1267 microversion: 2.1 time: 0.235168 Aug 31 07:01:29.002029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 19/32] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:28 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:29.174070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:29.174884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:29.195298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:29.196569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:29.197217 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:29.198269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:29.198880 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:29.199504 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:29.672842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:29.682064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:29.689270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:29.692130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:29.693505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:29.697327 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:29.698189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:29.699993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:30.158996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:30.176795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:30.181363 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:30.188686 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8407744d-30e4-4090-b71e-6fa7750bdba4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1339 microversion: 2.20 time: 0.517769 Aug 31 07:01:30.190914 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 20/33] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:29 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1339 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:30.211932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:30.212885 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:30.240139 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:30.240645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:30.241080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:30.274569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:30.276791 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:30.277301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:30.695231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:30.725977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3af2e6ec-b999-4ec9-aa71-644a7c38e38a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1279 microversion: 2.1 time: 1.542556 Aug 31 07:01:30.733863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 14/34] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:29 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1279 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:31.214128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:31.214806 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:31.226091 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:31.226607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:31.227065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:31.227883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:31.228446 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:31.228911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:31.249591 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:31.265744 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fd3d203e-f0d1-4b30-b350-faf68013b35b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1275 microversion: 2.1 time: 1.071399 Aug 31 07:01:31.281933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 21/35] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:30 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1275 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:31.749933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:31.750867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:31.763554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:31.766805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:31.767616 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:31.771280 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:31.772683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:31.776252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:32.022154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:32.067367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:32.070183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:32.081213 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-44ad900d-b9b3-48ad-b06d-e087868204b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1339 microversion: 2.20 time: 0.862205 Aug 31 07:01:32.082321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 15/36] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:31 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1339 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:01:32.335453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:32.336668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:32.405834 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:32.409394 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:32.412824 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:32.416707 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:32.419777 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:32.420704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:32.797954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:32.810463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8c08ef09-2541-4a64-b70f-80fe131c1e2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1273 microversion: 2.1 time: 0.517618 Aug 31 07:01:32.812804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 16/37] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:32 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1273 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:33.111477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:33.112137 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:33.132322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:33.132835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:33.135673 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:33.136461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:33.136937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:33.137369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:33.299612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:33.316009 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-35dbf17c-4776-4510-8c1b-0605f9826a61 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 1.571652 Aug 31 07:01:33.332483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 22/38] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:31 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:01:33.459565 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:33.471647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:33.477219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:33.481572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a7b00010-9739-4175-8503-2564c28a5a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1339 microversion: 2.20 time: 0.375538 Aug 31 07:01:33.483203 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 17/39] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:33 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1339 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:33.833477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:33.834461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:33.848310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:33.849090 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:33.850468 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:33.853569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:33.855426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:33.856717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:34.206434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:34.219858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3d92f24b-b20d-4285-8aaf-f85d9ea2e0e8 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1273 microversion: 2.1 time: 0.390671 Aug 31 07:01:34.221380 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 23/40] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:33 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:34.337180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:34.338195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:34.340703 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=6 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:34.362950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:34.370450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:34.373109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:34.376379 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:34.380133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:34.382652 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:34.509782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:34.510520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:34.535207 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:34.536233 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:34.537311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:34.539751 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:34.540541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:34.541327 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:35.142367 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:35.161524 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:35.166172 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:35.169897 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e76bf80f-5227-4d75-8e0c-a50a23c80860 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.667336 Aug 31 07:01:35.170555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 24/41] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:34 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:01:35.243574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:35.244858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:35.262786 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:35.263347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:35.263804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:35.264556 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:35.265024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:35.265484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:35.527475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:35.548023 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:35.557652 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:35.569765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-659db86d-32eb-466b-a8ea-e1f55df20483 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 1.236526 Aug 31 07:01:35.581575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ae8da2cc-98cf-408a-942e-317865ab6e7f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1273 microversion: 2.1 time: 0.341621 Aug 31 07:01:35.594906 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 18/42] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:34 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:35.595123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:35 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:01:35.741690 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-e987b7d6-68a8-4659-a7c5-6f6e445d3799 req-1b3d0f1a-a7c7-44fa-87a1-5f0677e98ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842ba2ac-ef4a-4dd0-8945-a6c32c24d16e", "tag": "f129b399-9742-4b1f-bd20-08e795e00145"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:35.792869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-e987b7d6-68a8-4659-a7c5-6f6e445d3799 req-1b3d0f1a-a7c7-44fa-87a1-5f0677e98ebc service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:35.796118 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-e987b7d6-68a8-4659-a7c5-6f6e445d3799 req-1b3d0f1a-a7c7-44fa-87a1-5f0677e98ebc service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:35.796992 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-e987b7d6-68a8-4659-a7c5-6f6e445d3799 req-1b3d0f1a-a7c7-44fa-87a1-5f0677e98ebc service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:35.844999 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-e987b7d6-68a8-4659-a7c5-6f6e445d3799 req-1b3d0f1a-a7c7-44fa-87a1-5f0677e98ebc service nova] Creating event network-changed:f129b399-9742-4b1f-bd20-08e795e00145 for instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e on hv-cinder-85528 Aug 31 07:01:35.845918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-e987b7d6-68a8-4659-a7c5-6f6e445d3799 req-1b3d0f1a-a7c7-44fa-87a1-5f0677e98ebc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 07:01:35.846460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-e987b7d6-68a8-4659-a7c5-6f6e445d3799 req-1b3d0f1a-a7c7-44fa-87a1-5f0677e98ebc service nova] Acquired lock "compute-rpcapi-router" {{(pid=120771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 07:01:35.847739 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:35.848477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:35.849128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:35.850038 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:35.851981 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:35.852591 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:35.874261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.compute.rpcapi [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 07:01:35.878606 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] Releasing lock "compute-rpcapi-router" {{(pid=120771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 07:01:35.909105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cd494ee6-c8a8-4666-a1fc-bd6d8f6fa45a None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321681 Aug 31 07:01:35.910274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 19/44] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:36.192560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=14 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:36.201042 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:36.202081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:36.215048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:36.218521 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:36.219301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:36.219923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:36.222276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:36.227872 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:36.231105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:36.584303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:36.603547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:36.604429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:36.607078 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:36.609491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:36.611131 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4748e99e-2f42-4f9f-95d3-e49f07505bd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.419172 Aug 31 07:01:36.612436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 26/45] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:36 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:36.618014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:36.618934 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:36.640697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:36.643527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:36.645478 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:36.645696 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:36.646365 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:36.648385 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:36.649599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:36.649764 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:36.650664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:36.651235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:36.651675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:36.656407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:37.047333 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:37.069547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a87ac52c-a98a-4b3a-ae77-7249fd35e847 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.455747 Aug 31 07:01:37.070144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 27/46] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:36 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:37.641920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:37.643768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:37.661492 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:37.665236 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:37.668478 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:37.672028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:37.673549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:37.675369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:37.716737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=24 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:37.726996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:37.740607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f1df5067-4042-4618-a01d-21dbd20f1060 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 1.141536 Aug 31 07:01:37.746337 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 20/47] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:36 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:38.093181 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:38.094063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:38.106007 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:38.107258 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:38.111287 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:38.112280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:38.113058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:38.115244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:38.206961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:38.228300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:38.229809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:38.230971 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0c848a4e-1a08-4706-ada9-ff74d85fc2e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.596087 Aug 31 07:01:38.265344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 28/48] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:37 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:01:38.732740 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:38.743404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ee3799eb-012a-4687-9c5c-f1921f627033 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.652748 Aug 31 07:01:38.747573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 21/49] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:38 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:38.767351 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:38.777094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:38.791759 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:38.796592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:38.805528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:38.808027 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:38.808861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:38.810894 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.346536 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-3a02b65b-c79f-4a7d-9273-a4fcd8ff6418 req-cde3b4c0-defc-41ea-873d-e6be822c20b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f889e287-ccdc-4c84-a33b-28a965c04abe", "tag": "44b98252-8525-4549-989f-9dd90c026d46"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:39.361782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a02b65b-c79f-4a7d-9273-a4fcd8ff6418 req-cde3b4c0-defc-41ea-873d-e6be822c20b7 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:39.372513 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a02b65b-c79f-4a7d-9273-a4fcd8ff6418 req-cde3b4c0-defc-41ea-873d-e6be822c20b7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:39.373523 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a02b65b-c79f-4a7d-9273-a4fcd8ff6418 req-cde3b4c0-defc-41ea-873d-e6be822c20b7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.410416 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-3a02b65b-c79f-4a7d-9273-a4fcd8ff6418 req-cde3b4c0-defc-41ea-873d-e6be822c20b7 service nova] Creating event network-changed:44b98252-8525-4549-989f-9dd90c026d46 for instance f889e287-ccdc-4c84-a33b-28a965c04abe on hv-cinder-85528 Aug 31 07:01:39.411466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a02b65b-c79f-4a7d-9273-a4fcd8ff6418 req-cde3b4c0-defc-41ea-873d-e6be822c20b7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 07:01:39.412344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a02b65b-c79f-4a7d-9273-a4fcd8ff6418 req-cde3b4c0-defc-41ea-873d-e6be822c20b7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 07:01:39.413557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:39.414161 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:39.414733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.415707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:39.416297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:39.416986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.428268 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.compute.rpcapi [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 07:01:39.429826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] Releasing lock "compute-rpcapi-router" {{(pid=120770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 07:01:39.454582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-060a892a-ce4e-4049-933a-00ac139c129b None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.726263 Aug 31 07:01:39.457692 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 29/50] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:01:39.469338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:39.470262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:39.482200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:39.483054 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:39.483655 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.484525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:39.485539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:39.486109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.622179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:39.655189 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6682e975-8af8-4e28-8ab1-93c1fc49cabb tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.890422 Aug 31 07:01:39.676792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 22/51] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:38 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:39.775075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:39.775732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:39.800897 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:39.801422 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:39.801869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.812169 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:39.812169 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:39.812589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:39.851517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:39.867415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:39.874661 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:39.876105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-49e72043-5989-4ad7-8a69-3f29c9158049 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.416567 Aug 31 07:01:39.876895 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 30/52] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:39 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:40.167850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:40.178127 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d6e5a21a-e295-4dca-bacf-e943ffba205d tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.409628 Aug 31 07:01:40.178736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 23/53] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:39 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:01:40.681891 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:40.682499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:40.688704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:40.689416 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:40.689950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:40.690707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:40.691311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:40.691868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:40.835229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:40.848962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-76ea6a40-db41-49fd-bfe3-939115a3e993 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.165503 Aug 31 07:01:40.848962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 31/54] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:40 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:40.899104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:40.900410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:40.902673 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:40.909261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:40.909680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:40.910190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:40.910792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:40.911316 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:40.911664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:40.929299 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=79 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:41.054015 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:41.064047 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:41.065802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:41.067250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1fd225f7-65d1-4a66-b9cb-ae45418fb8f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.172342 Aug 31 07:01:41.068472 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 24/55] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:40 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:41.209820 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:41.210957 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:41.238538 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:41.239270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:41.240037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:41.241653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:41.242347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:41.242952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:41.419374 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:41.431025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3ddbb196-1de3-4c65-9f4c-c73fd3103bfd tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.234585 Aug 31 07:01:41.431601 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 32/56] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:41 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:41.489566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-7f00712d-7ee5-415a-85a3-b269f0c7af06 req-91a345ff-c1e3-4999-930e-d0d7bf826c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511f1298-6885-4659-86c4-2bb83fa7803b", "tag": "f1143e84-14e6-46df-9c89-a9a60f4e8a19"}, {"name": "network-changed", "server_uuid": "d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d", "tag": "578326bc-9387-4f2f-8bae-b45b789256f8"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:41.501279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-7f00712d-7ee5-415a-85a3-b269f0c7af06 req-91a345ff-c1e3-4999-930e-d0d7bf826c78 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:41.502797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-7f00712d-7ee5-415a-85a3-b269f0c7af06 req-91a345ff-c1e3-4999-930e-d0d7bf826c78 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:41.503677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-7f00712d-7ee5-415a-85a3-b269f0c7af06 req-91a345ff-c1e3-4999-930e-d0d7bf826c78 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:41.518875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-7f00712d-7ee5-415a-85a3-b269f0c7af06 req-91a345ff-c1e3-4999-930e-d0d7bf826c78 service nova] Creating event network-changed:f1143e84-14e6-46df-9c89-a9a60f4e8a19 for instance 511f1298-6885-4659-86c4-2bb83fa7803b on hv-cinder-85528 Aug 31 07:01:41.519361 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-7f00712d-7ee5-415a-85a3-b269f0c7af06 req-91a345ff-c1e3-4999-930e-d0d7bf826c78 service nova] Creating event network-changed:578326bc-9387-4f2f-8bae-b45b789256f8 for instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d on hv-cinder-85528 Aug 31 07:01:41.525943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-7f00712d-7ee5-415a-85a3-b269f0c7af06 req-91a345ff-c1e3-4999-930e-d0d7bf826c78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040281 Aug 31 07:01:41.526605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 25/57] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:01:41.864675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:41.865952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:41.872314 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:41.873105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:41.873867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:41.874715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:41.875346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:41.876311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:41.913019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:42.074270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:42.090536 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b1a0a053-2c2f-46cd-8b3b-a03f40b7a75c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.229766 Aug 31 07:01:42.091911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:42.092678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:42.094443 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 33/58] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:41 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:42.116032 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:42.116513 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:42.117009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:42.121584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:42.122066 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:42.122559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:42.453392 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:42.454996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:42.465833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:42.467501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:42.468079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:42.470589 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:42.471306 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:42.472726 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:42.652701 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:42.661198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-24c9a1d2-57eb-4d35-bab9-05ed927eb151 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.211912 Aug 31 07:01:42.662312 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 34/59] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:42 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:01:42.880864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:42.898711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:42.901009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:42.904733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-484911be-31ad-45ec-afe1-f8f66fabe674 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.818357 Aug 31 07:01:42.906607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 26/60] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:42 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:43.116674 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:43.116674 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:43.123773 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:43.124264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:43.124860 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:43.125913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:43.126629 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:43.127240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:43.302595 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:43.308209 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1e381bf2-fccb-443f-bb1d-4736610d61ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.197565 Aug 31 07:01:43.308790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 35/61] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:43 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:43.684390 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:43.685178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:43.691741 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:43.692456 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:43.692881 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:43.693564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:43.694832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:43.695415 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:43.863019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:43.872202 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6e59ff56-f036-487a-8a43-342356a31629 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.192148 Aug 31 07:01:43.886874 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 27/62] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:43 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:43.929682 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:43.930599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:43.937941 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:43.938621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:43.939254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:43.940105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:43.940833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:43.941512 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:44.081049 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:44.089489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:44.091205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:44.092410 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-eb8563a4-7054-4d97-a7b7-06a811aad2b1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.166617 Aug 31 07:01:44.093364 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 36/63] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:43 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:44.329742 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:44.330514 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:44.336870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:44.337279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:44.337703 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:44.338397 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:44.338860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:44.339284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:44.474705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:44.482403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ed586e15-5c17-4a50-947b-088ed8032524 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.156731 Aug 31 07:01:44.483162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 28/64] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:44 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:44.893981 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:44.894829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:44.901643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:44.902127 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:44.902553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:44.903263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:44.903705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:44.904120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:45.042251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:45.050344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-63aa75c6-820b-4e0c-b958-de7f0c92e6ce tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.160529 Aug 31 07:01:45.051043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 37/65] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:44 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:45.116023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:45.116627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:45.122896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:45.123482 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:45.124010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:45.124825 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:45.125269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:45.125836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:45.271040 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:45.280280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:45.281716 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:45.283148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-40e5dd94-009b-4795-a7a0-6d5c8ef13a2c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.171302 Aug 31 07:01:45.283717 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 29/66] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:45 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:45.503382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:45.504015 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:45.510357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:45.510859 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:45.511320 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:45.512018 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:45.512462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:45.512863 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:45.652311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:45.660258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d58c5a21-0a20-488d-96ab-98d86e6f4082 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.160887 Aug 31 07:01:45.660971 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 38/67] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:45 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:46.070938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:46.071547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:46.073587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:46.080816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:46.081150 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:46.081602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:46.082300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:46.082736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:46.083180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:46.215022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:46.223092 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-49c64e3d-f1fc-411c-b5d6-d5139d01e041 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.155986 Aug 31 07:01:46.223655 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 30/68] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:46 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:46.305519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:46.306125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:46.312124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:46.312618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:46.313051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:46.313732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:46.314182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:46.314609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:46.448667 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:46.457199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:46.458640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:46.459778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6cec048e-e6af-4682-9575-080e4323af42 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.158145 Aug 31 07:01:46.460338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 39/69] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:46 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:46.681361 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:46.682095 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:46.688909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:46.689391 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:46.689861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:46.690580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:46.691209 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:46.691644 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:46.845179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:46.852953 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-512b5861-2a88-451f-bb23-3a68e29a4494 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.175457 Aug 31 07:01:46.853529 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 31/70] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:46 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:47.221826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-656cbb7c-325c-4b8e-8c05-87b27a32af83 req-ab894517-659d-408a-a98b-cd92690de4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842ba2ac-ef4a-4dd0-8945-a6c32c24d16e", "name": "network-vif-plugged", "status": "completed", "tag": "f129b399-9742-4b1f-bd20-08e795e00145"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:47.231442 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-656cbb7c-325c-4b8e-8c05-87b27a32af83 req-ab894517-659d-408a-a98b-cd92690de4a5 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:47.231914 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-656cbb7c-325c-4b8e-8c05-87b27a32af83 req-ab894517-659d-408a-a98b-cd92690de4a5 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:47.232333 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-656cbb7c-325c-4b8e-8c05-87b27a32af83 req-ab894517-659d-408a-a98b-cd92690de4a5 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:47.243606 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:47.244215 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:47.246043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-656cbb7c-325c-4b8e-8c05-87b27a32af83 req-ab894517-659d-408a-a98b-cd92690de4a5 service nova] Creating event network-vif-plugged:f129b399-9742-4b1f-bd20-08e795e00145 for instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e on hv-cinder-85528 Aug 31 07:01:47.250043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:47.250572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:47.251271 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:47.251672 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-656cbb7c-325c-4b8e-8c05-87b27a32af83 req-ab894517-659d-408a-a98b-cd92690de4a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085461 Aug 31 07:01:47.252136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:47.252853 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:47.253468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:47.255413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 40/71] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:47.387856 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:47.395742 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-561abf2b-1e47-4a45-b558-ef687db8d18f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.155986 Aug 31 07:01:47.396450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 32/72] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:47 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:01:47.482246 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:47.482970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:47.489410 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:47.489886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:47.490317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:47.491039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:47.491487 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:47.491904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:47.627336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:47.639742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:47.641222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:47.642395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-88633fa9-15a6-4c8d-9a9c-ec6f5669cb40 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.164387 Aug 31 07:01:47.644358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 41/73] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:47 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:47.875972 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:47.876795 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:47.885223 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:47.885763 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:47.886192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:47.886975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:47.887453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:47.887888 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:48.044743 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:48.053229 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-25b6d8ab-fad3-4343-a8ce-b3b5327d9d74 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.182993 Aug 31 07:01:48.053935 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 33/74] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:47 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:48.416677 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:48.417187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:48.423205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:48.423682 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:48.424111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:48.424985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:48.425424 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:48.426436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:48.555359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:48.562920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-eb6f1d78-2939-4171-92dc-724b489eff85 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.150087 Aug 31 07:01:48.563567 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 42/75] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:48 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:48.665859 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:48.666484 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:48.672499 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:48.672973 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:48.673392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:48.674070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:48.674830 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:48.675594 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:48.814453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:48.823198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:48.824631 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:48.825762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e883e58b-fc3d-44f5-a33f-fdb7e075c150 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.164140 Aug 31 07:01:48.826414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 34/76] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:48 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:49.077044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:49.077660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:49.083890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:49.084375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:49.084879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:49.085480 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:49.085933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:49.086351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:49.222681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:49.230545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-56175b19-ded4-4e87-b40e-d440fccd75a7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.160768 Aug 31 07:01:49.231151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 43/77] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:49 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:49.583967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:49.584894 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:49.591155 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:49.592079 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:49.592721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:49.593918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:49.594567 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:49.595276 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:49.812466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:49.820315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d1265bba-fe5b-4453-ba26-556518be5515 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.240213 Aug 31 07:01:49.820886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 35/78] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:49 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:49.849479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:49.850076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:49.852166 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:49.857378 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:49.857859 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:49.858254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:49.858966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:49.859401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:49.859814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:49.992331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:50.005568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:50.008004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:50.009718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fc8d135e-244b-4826-84a6-f252aac7f344 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.164243 Aug 31 07:01:50.010506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 44/79] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:49 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:50.251860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:50.252684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:50.259161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:50.259649 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:50.260073 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:50.260761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:50.261207 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:50.261622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:50.399758 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:50.407372 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5c76a45a-20da-4025-adf2-6bd361dd89d3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.159760 Aug 31 07:01:50.407953 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 36/80] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:50 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:50.844715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:50.845685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:50.852535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:50.853108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:50.853439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:50.854129 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:50.854582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:50.855052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:50.993621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:51.001850 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-73898569-48cf-40f6-8a64-a9304593492c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.163500 Aug 31 07:01:51.002436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 45/81] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:50 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:51.033892 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:51.034541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:51.041386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:51.041873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:51.042303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:51.043045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:51.043494 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:51.043910 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:51.186365 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:51.195041 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:51.196477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:51.197596 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e6705d33-99de-41c2-8e6b-15d3bd865b5c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.167767 Aug 31 07:01:51.198151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 37/82] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:51 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:51.430775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:51.431472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:51.437969 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:51.438340 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:51.438770 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:51.439518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:51.440059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:51.440475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:51.570022 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:51.577742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-78f32409-0ef8-4ed7-ab96-3b2194284823 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.151699 Aug 31 07:01:51.578317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 46/83] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:51 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:52.027337 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:52.028224 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:52.038542 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:52.039291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:52.039725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:52.040711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:52.041267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:52.041785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:52.182985 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:52.191321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bf56b629-49e3-408c-b1f2-e7430ea28441 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.170320 Aug 31 07:01:52.193543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 38/84] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:52 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:52.220475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:52.221080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:52.227690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:52.228177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:52.228607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:52.229311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:52.229759 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:52.230214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:52.359170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:52.367456 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:52.368890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:52.369980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ce80eeaa-8e5e-46cc-84ad-633d6ab95bd2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.153682 Aug 31 07:01:52.370742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 47/85] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:52 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:52.599441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:52.600200 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:52.607279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:52.608014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:52.608479 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:52.609325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:52.609787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:52.610204 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:52.750642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:52.767961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0d6e0e99-8ab8-4e34-af23-7ec673f0176b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.173459 Aug 31 07:01:52.773841 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 39/86] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:52 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:53.212996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:53.213614 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:53.220220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:53.220816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:53.222297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:53.223191 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:53.223649 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:53.224077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:53.385231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:53.395202 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:53.396600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:53.398766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ac6fccc1-f9a5-4ba6-a90d-c0f5a580cf53 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.190892 Aug 31 07:01:53.399781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 48/87] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:53 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:01:53.425873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:53.427799 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:53.428827 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:53.430872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:53.432020 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:53.432462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:53.698999 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:53.709168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:53.710800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:53.711954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d0a081d3-777f-414f-801e-ffd9359c86f1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.322595 Aug 31 07:01:53.712516 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 40/88] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:53 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:53.792414 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:53.793286 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:53.802341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:53.804874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:53.808702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:53.809665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:53.810228 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:53.811875 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:53.976819 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:53.989010 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c23b1759-2c17-49fe-bbf7-da51135ce8e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.198249 Aug 31 07:01:53.989645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 49/89] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:53 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:54.422073 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:54.422702 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:54.430473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:54.431039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:54.431537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:54.432277 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:54.432729 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:54.433154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:54.734238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:54.739727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:54.746519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:54.747794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:54.748359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:54.749422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:54.750479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:54.751288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:54.922100 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:54.930050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:54.933108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:54.935724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:54.936858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-69c070f5-4019-4d4d-8438-4d833e581765 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.206810 Aug 31 07:01:54.958039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:54.962793 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 50/90] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:54 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:54.964902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=100 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:01:54.971543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-5858e5c9-33f3-448a-b1a5-765a01f20bb0 req-11cda64a-9ad1-4c74-83db-8eca9f37ad7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f889e287-ccdc-4c84-a33b-28a965c04abe", "name": "network-vif-plugged", "status": "completed", "tag": "44b98252-8525-4549-989f-9dd90c026d46"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:54.980043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-127abcbc-492d-404d-b18a-3e4589e87dec tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.562795 Aug 31 07:01:54.985201 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 41/91] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:54 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:55.004706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-5858e5c9-33f3-448a-b1a5-765a01f20bb0 req-11cda64a-9ad1-4c74-83db-8eca9f37ad7f service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:55.006181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-5858e5c9-33f3-448a-b1a5-765a01f20bb0 req-11cda64a-9ad1-4c74-83db-8eca9f37ad7f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:55.008126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-5858e5c9-33f3-448a-b1a5-765a01f20bb0 req-11cda64a-9ad1-4c74-83db-8eca9f37ad7f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:55.010475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:55.011036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:55.018338 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:55.021328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:55.023101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:55.024498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:55.026322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:55.026923 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:55.038099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-5858e5c9-33f3-448a-b1a5-765a01f20bb0 req-11cda64a-9ad1-4c74-83db-8eca9f37ad7f service nova] Creating event network-vif-plugged:44b98252-8525-4549-989f-9dd90c026d46 for instance f889e287-ccdc-4c84-a33b-28a965c04abe on hv-cinder-85528 Aug 31 07:01:55.047765 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-5858e5c9-33f3-448a-b1a5-765a01f20bb0 req-11cda64a-9ad1-4c74-83db-8eca9f37ad7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083103 Aug 31 07:01:55.048208 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 51/92] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:01:55.401284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:55.418239 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-40d46812-2349-4729-91a9-f05d72b9d492 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.411378 Aug 31 07:01:55.431326 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 42/93] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:55 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:55.963702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:55.964360 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:55.971211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:55.972062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:55.972660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:55.973408 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:55.973813 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:55.974202 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:56.006572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:56.007439 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:56.015658 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:56.016951 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:56.017383 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:56.018100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:56.018551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:56.019003 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:56.376074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:56.386196 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e3e96504-9dad-4600-9182-c3c9de45c19a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.384414 Aug 31 07:01:56.386775 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 43/94] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:56 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:56.448809 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:56.452384 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:56.465498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:56.470872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:56.471580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:56.472666 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:56.473358 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:56.473763 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:56.524508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:56.547715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:56.552507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:56.555248 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a0f58575-fa34-4191-8772-032a0990366a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.596469 Aug 31 07:01:56.557422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 52/95] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:55 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:56.842800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:56.857497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d700d94d-1c75-436b-8e45-631ac9ccf1f4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1321 microversion: 2.1 time: 0.420091 Aug 31 07:01:56.858131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 44/96] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:56 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:57.090322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-84c8979f-c2ac-4343-80e8-98137bc6c6e5 req-209c7974-d1bf-415a-a7fe-4a2cde287e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511f1298-6885-4659-86c4-2bb83fa7803b", "name": "network-vif-plugged", "status": "completed", "tag": "f1143e84-14e6-46df-9c89-a9a60f4e8a19"}, {"server_uuid": "d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d", "name": "network-vif-plugged", "status": "completed", "tag": "578326bc-9387-4f2f-8bae-b45b789256f8"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:57.107633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-84c8979f-c2ac-4343-80e8-98137bc6c6e5 req-209c7974-d1bf-415a-a7fe-4a2cde287e44 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:57.109025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-84c8979f-c2ac-4343-80e8-98137bc6c6e5 req-209c7974-d1bf-415a-a7fe-4a2cde287e44 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:57.110919 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-84c8979f-c2ac-4343-80e8-98137bc6c6e5 req-209c7974-d1bf-415a-a7fe-4a2cde287e44 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:57.127310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-84c8979f-c2ac-4343-80e8-98137bc6c6e5 req-209c7974-d1bf-415a-a7fe-4a2cde287e44 service nova] Creating event network-vif-plugged:f1143e84-14e6-46df-9c89-a9a60f4e8a19 for instance 511f1298-6885-4659-86c4-2bb83fa7803b on hv-cinder-85528 Aug 31 07:01:57.128464 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-84c8979f-c2ac-4343-80e8-98137bc6c6e5 req-209c7974-d1bf-415a-a7fe-4a2cde287e44 service nova] Creating event network-vif-plugged:578326bc-9387-4f2f-8bae-b45b789256f8 for instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d on hv-cinder-85528 Aug 31 07:01:57.172098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-84c8979f-c2ac-4343-80e8-98137bc6c6e5 req-209c7974-d1bf-415a-a7fe-4a2cde287e44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087771 Aug 31 07:01:57.182778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 53/97] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:01:57.408520 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:57.411521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:57.426806 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:57.427666 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:57.428254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:57.429840 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:57.430569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:57.431153 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:57.582401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:57.583142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:57.607065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:57.607285 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:57.607900 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:57.608753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:57.609427 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:57.612700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:57.883993 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:57.887986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:57.896236 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-868154fe-e351-4dd0-ab6f-4a07dd2b419c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.493016 Aug 31 07:01:57.897451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 45/98] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:57 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:57.903535 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:57.904367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:57.906016 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:57.908068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:57.909206 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2cb042d3-8632-46f0-94da-bdea47d71d82 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.331530 Aug 31 07:01:57.909945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 54/99] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:57 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:57.913332 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:57.913990 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:57.915062 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:57.916314 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:57.916926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:57.917549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.231082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:58.242824 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-832b06e0-2737-47c0-be0d-fb9363fe4f56 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1514 microversion: 2.1 time: 0.343400 Aug 31 07:01:58.243864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 46/100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:57 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:58.271290 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:01:58.292315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:58.307754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.311981 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.319214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.322739 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.323718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.326721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.517687 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lazy-loading 'flavor' on Instance uuid f889e287-ccdc-4c84-a33b-28a965c04abe {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:01:58.705185 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-77272d0c-2331-45ca-92c9-3c51caf57d2e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe/action" status: 200 len: 32 microversion: 2.1 time: 0.444145 Aug 31 07:01:58.706214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 55/101] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:01:58 2022] POST /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:01:58.721879 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:58.722534 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:58.731211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.731847 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.732527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.733398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.734133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.734714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.892053 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:58.901489 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ff76a22b-7f61-4a07-91e8-d9562b1fcb65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.189977 Aug 31 07:01:58.924420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:58.926021 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:58.931619 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 47/102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:58 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:01:58.942788 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:58.943417 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:58.947589 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.948075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.948495 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.949336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.949915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.950331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.958056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.958943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.960108 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:58.962005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:58.962837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:58.963749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:59.112653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:59.121048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b448e6c9-f6d2-45b5-a6ac-98c604115935 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.204214 Aug 31 07:01:59.135408 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 56/103] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:58 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:01:59.165582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:59.174467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:59.175900 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:01:59.177014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-271b8c43-ae81-4999-bc1f-7f5a1f3d23c1 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1407 microversion: 2.20 time: 0.244348 Aug 31 07:01:59.177909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 48/104] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:01:58 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:01:59.929222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:01:59.930026 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:01:59.938273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:59.939413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:59.941611 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:01:59.943839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:01:59.944948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:01:59.945429 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:00.143399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:00.144117 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:00.156951 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:00.157451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:00.157887 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:00.164925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:00.166115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:00.166783 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:00.223970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:00.240264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-497ae4a4-f7dc-4135-9a49-153b9867db47 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.315423 Aug 31 07:02:00.243545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 57/105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:01:59 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:00.254454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:00.258161 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:00.273848 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:00.274636 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:00.277438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:00.278447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:00.279095 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:00.282052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:00.380368 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:00.392164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-36b1edf6-c567-4711-a78e-ff27ecbb597a tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1315 microversion: 2.1 time: 0.253714 Aug 31 07:02:00.394094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 49/106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:00 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:00.523308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:00.532590 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:00.534292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:00.535777 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1c09bad9-c2e0-4f0b-bb93-006e234f39ec tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1600 microversion: 2.20 time: 0.291023 Aug 31 07:02:00.536547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 58/107] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:02:00 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1600 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:02:00.560409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:00.560908 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:00.567913 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:00.568624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:00.569051 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:00.569896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:00.570344 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:00.570773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:00.694333 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-36176b95-0c3f-4ce9-8bc9-8a1d0a83ad43 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.138586 Aug 31 07:02:00.695505 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 50/108] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 31 07:02:00 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 07:02:01.266004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:01.266833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:01.279038 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:01.279664 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:01.282211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:01.285197 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:01.286182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:01.287616 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:01.416695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:01.417293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:01.425637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:01.426877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:01.427961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:01.429321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:01.431745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:01.433300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:01.592681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:01.602333 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-49e65c3e-534b-4348-aeea-fa8f773d1e80 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.341445 Aug 31 07:02:01.602932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 59/109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:01 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:02.062605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:02.076949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-beedba5c-65c0-4b0e-8a49-921a45afd37f tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1502 microversion: 2.1 time: 0.663764 Aug 31 07:02:02.088978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 51/110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:01 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1502 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:02.622374 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:02.623209 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:02.634069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:02.636874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:02.637544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:02.639728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:02.641209 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:02.641995 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:03.013985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:03.026399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-07c931c1-db63-4aaf-ae6d-56886c5b9953 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.407316 Aug 31 07:02:03.043614 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 60/111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:02 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:03.256551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-8146b3ca-e411-4729-919f-7fb4342535d9 req-e450b7f8-c687-49eb-93b0-b4bb054acf7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511f1298-6885-4659-86c4-2bb83fa7803b", "tag": "f1143e84-14e6-46df-9c89-a9a60f4e8a19"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:03.285671 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8146b3ca-e411-4729-919f-7fb4342535d9 req-e450b7f8-c687-49eb-93b0-b4bb054acf7d service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:03.287772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8146b3ca-e411-4729-919f-7fb4342535d9 req-e450b7f8-c687-49eb-93b0-b4bb054acf7d service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:03.292025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8146b3ca-e411-4729-919f-7fb4342535d9 req-e450b7f8-c687-49eb-93b0-b4bb054acf7d service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:03.347032 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-8146b3ca-e411-4729-919f-7fb4342535d9 req-e450b7f8-c687-49eb-93b0-b4bb054acf7d service nova] Creating event network-changed:f1143e84-14e6-46df-9c89-a9a60f4e8a19 for instance 511f1298-6885-4659-86c4-2bb83fa7803b on hv-cinder-85528 Aug 31 07:02:03.353855 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-8146b3ca-e411-4729-919f-7fb4342535d9 req-e450b7f8-c687-49eb-93b0-b4bb054acf7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101046 Aug 31 07:02:03.355794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 52/112] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:02:04.051361 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:04.052574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:04.064795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:04.066302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:04.068530 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:04.069232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e9cc02f-a7a9-490e-b14b-9a0fdc34db61"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:04.069737 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:04.071246 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:04.072058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:04.072302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:04.079772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:04.080614 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:04.081196 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:04.082536 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:04.084820 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:04.085571 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:04.408165 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:04.431640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ecccebd6-ea68-4cc3-9670-2e1eca6e6942 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.384184 Aug 31 07:02:04.435903 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 61/113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:04 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:04.764860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-83915724-4745-440e-820d-80516463dcc9 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "POST /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700521 Aug 31 07:02:04.784559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 53/114] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:02:04 2022] POST /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:02:05.455950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:05.458829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:05.468386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:05.469346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:05.469802 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:05.471205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:05.471766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:05.472443 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:05.617529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:05.626386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-00ce09b1-0049-4caf-8b39-42c019410584 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.174588 Aug 31 07:02:05.627218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 62/115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:05 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:06.648850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:06.649383 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:06.657668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:06.658155 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:06.658570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:06.660140 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:06.660596 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:06.661016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:06.838391 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:06.849448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0d4281ab-3014-449e-ad93-0595b6570b0c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.204613 Aug 31 07:02:06.850323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 54/116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:06 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:07.872838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:07.873541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:07.875704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=74 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:07.881038 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:07.881517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:07.881946 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:07.882634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:07.883150 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:07.894683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:08.095221 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:08.104745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-52e394e7-a471-4433-9193-018925406867 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.235582 Aug 31 07:02:08.106893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 63/117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:07 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:09.126056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:09.126778 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:09.135493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:09.136551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:09.137405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:09.138390 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:09.139416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:09.139940 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:09.373082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:09.392895 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-89f68124-91ac-468e-84b9-b25ce6a26e79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.270776 Aug 31 07:02:09.395341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 55/118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:09 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:10.418198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:10.419976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:10.426956 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:10.427537 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:10.428289 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:10.429182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:10.429774 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:10.430189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:10.626051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:10.636991 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-23a1d5ca-1495-41c0-974b-f10a095461fa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.223546 Aug 31 07:02:10.637566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 64/119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:10 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:11.658628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:11.659464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:11.662551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=64 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:11.670006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:11.670665 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:11.671385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:11.672420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:11.673002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:11.673570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:11.859199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:11.867855 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7964e6d3-a14f-49f8-901d-6666caaebb5f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.213283 Aug 31 07:02:11.868757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 56/120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:11 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:12.889989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:12.890608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:12.897769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:12.898265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:12.898698 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:12.899439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:12.899890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:12.900320 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:13.106884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:13.116137 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-32e1d1a5-a6d0-40c4-94e3-b40de859f204 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.230149 Aug 31 07:02:13.116912 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 65/121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:12 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:14.137480 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:14.138736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:14.147957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:14.148666 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:14.149179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:14.150101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:14.150601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:14.151240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:14.521091 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:14.557250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a64d8b4c-1ad8-4e85-bc19-8968c1cee6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.423788 Aug 31 07:02:14.560437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 57/122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:14 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:15.583571 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:15.584233 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:15.591515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:15.592531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:15.593246 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:15.594214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:15.594953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:15.595581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:15.763808 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:15.767260 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:15.773646 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2df2a7f1-9ae8-4156-b422-030bb4a279b9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.194792 Aug 31 07:02:15.778763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 66/123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:15 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:15.814404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:15.815044 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:15.825668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:15.826192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:15.827047 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:15.827764 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:15.828219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:15.829135 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:15.832885 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:15.865119 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:02:16.012378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1683d0b0-e635-4990-98b0-40df97d9e584 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 204 len: 0 microversion: 2.1 time: 0.202649 Aug 31 07:02:16.013483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 58/124] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:02:15 2022] DELETE /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:02:16.023986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:16.024790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:16.031498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:16.032192 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:16.032932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:16.034442 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:16.035230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:16.035781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:16.235773 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:16.250452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1b02f059-8f8d-483a-a0d0-45e86b5d4513 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1554 microversion: 2.1 time: 0.232148 Aug 31 07:02:16.251892 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 67/125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:16 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:16.801765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:16.802527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:16.814785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:16.815305 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:16.815711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:16.816846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:16.817301 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:16.817723 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:17.032155 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:17.045377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9660a9c7-c59b-42e1-9c28-8996ba0f9401 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.248930 Aug 31 07:02:17.045997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 59/126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:16 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:17.274501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:17.275633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:17.281816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:17.282315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:17.282811 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:17.283657 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:17.284118 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:17.284542 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:17.451858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:17.461518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d3e15987-94ae-4876-b60f-7b6759a88b5e tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1554 microversion: 2.1 time: 0.191800 Aug 31 07:02:17.462235 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 68/127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:17 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:18.070656 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:18.072125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:18.078453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:18.079274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:18.079946 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:18.080886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:18.081537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:18.082299 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:18.246316 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:18.255232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6931f4a6-3ae5-4289-9654-10d183945550 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.190402 Aug 31 07:02:18.255814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 60/128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:18 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:18.483833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:18.485391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:18.494252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:18.494738 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:18.495213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:18.495908 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:18.496351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:18.496784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:18.669099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:18.689105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0d5ebb4c-efcc-4e03-9edc-388e305e43f5 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1554 microversion: 2.1 time: 0.209741 Aug 31 07:02:18.689907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 69/129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:18 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:19.285595 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:19.286187 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:19.307384 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:19.308515 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:19.309280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:19.310299 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:19.311479 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:19.312154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:19.589069 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:19.613920 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9b82a0ff-f9a0-4bd4-8173-e347e8bca359 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.340667 Aug 31 07:02:19.615035 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 61/130] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:19 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:19.711612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:19.712863 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:19.730065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:19.733287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:19.734027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:19.735024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:19.738319 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:19.752011 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:19.894138 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-cb37ba47-7ad6-46a0-a525-ed1768768c55 req-17ed21ba-fd8a-4a3a-b1ed-afb9ba928d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d", "name": "network-vif-deleted", "tag": "578326bc-9387-4f2f-8bae-b45b789256f8"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:19.897124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:19.907596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3faa24eb-0ed1-471e-a373-45bc7d41ed2b tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1512 microversion: 2.1 time: 0.200389 Aug 31 07:02:19.908422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 70/131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:19 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:19.922968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-cb37ba47-7ad6-46a0-a525-ed1768768c55 req-17ed21ba-fd8a-4a3a-b1ed-afb9ba928d92 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:19.927428 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-cb37ba47-7ad6-46a0-a525-ed1768768c55 req-17ed21ba-fd8a-4a3a-b1ed-afb9ba928d92 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:19.930764 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-cb37ba47-7ad6-46a0-a525-ed1768768c55 req-17ed21ba-fd8a-4a3a-b1ed-afb9ba928d92 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:19.951286 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-cb37ba47-7ad6-46a0-a525-ed1768768c55 req-17ed21ba-fd8a-4a3a-b1ed-afb9ba928d92 service nova] Creating event network-vif-deleted:578326bc-9387-4f2f-8bae-b45b789256f8 for instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d on hv-cinder-85528 Aug 31 07:02:19.960355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-cb37ba47-7ad6-46a0-a525-ed1768768c55 req-17ed21ba-fd8a-4a3a-b1ed-afb9ba928d92 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071315 Aug 31 07:02:19.964296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 62/132] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:02:20.637271 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:20.638156 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:20.646802 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:20.647674 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:20.648293 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:20.650338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:20.650832 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:20.651350 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:20.817426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:20.835071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-700d58cc-4c3b-4bab-b1da-4570c0952b96 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.202661 Aug 31 07:02:20.837671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 71/133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:20 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:20.936462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:20.937433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:20.945677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:20.946515 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:20.947199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:20.948688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:20.949302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:20.950112 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:21.003088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:21.003704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:21.009787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:21.010276 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lazy-loading 'fault' on Instance uuid d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:02:21.075574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab0b2264a244a98f90769b266ccb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84d820464c34a30bee606e1c7f711c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:21.083958 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e277956c-5c0d-4f03-9577-f2ceb5175136 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 200 len: 1351 microversion: 2.1 time: 0.156229 Aug 31 07:02:21.084707 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 63/134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:20 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 1351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:21.857934 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:21.858543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:21.865947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:21.866446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:21.866958 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:21.867709 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:21.868152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:21.868572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:22.014992 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:22.024623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a2667fa4-2fc0-4462-a533-b5410ab96dca tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.170773 Aug 31 07:02:22.025269 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 72/135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:21 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:22.105465 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:22.106039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:22.115765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:22.116246 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:22.116732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:22.117426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:22.117871 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:22.118292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:22.132058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] HTTP exception thrown: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Request method failure captured: Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d HTTP/1.1 Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc_yNnlBiz6HP97GcMg0QfeVFBbRCAQ5II7prncOYYfKoL0Vj5LbtSOqxpXngvgBg7qMJpS45-ESPxQGxkKB4JLtTCp_9r_shcnDjvYaOwJf_VVtFIEuuKDQqQwf1oGxcl1yiz0O0gsOb3ZHSed7c3fiOAqtepCq3xa57J0a9dc9cY Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:02:22.137094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e84d820464c34a30bee606e1c7f711c9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 45ab0b2264a244a98f90769b266ccb3a Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.138525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'd0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d'} Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:02:22.139754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.140866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.141827 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Returning 404 to user: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:02:22.141827 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-db6741eb-6b76-431c-b947-0e5c916fda77 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 404 len: 111 microversion: 2.1 time: 0.037050 Aug 31 07:02:22.141827 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 64/136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:22 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:02:22.264412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:22.267051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:22.273886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:22.274469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:22.275078 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:22.275844 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:22.276299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:22.276718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:22.290532 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] HTTP exception thrown: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Request method failure captured: Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d/os-volume_attachments HTTP/1.1 Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwc_yNnlBiz6HP97GcMg0QfeVFBbRCAQ5II7prncOYYfKoL0Vj5LbtSOqxpXngvgBg7qMJpS45-ESPxQGxkKB4JLtTCp_9r_shcnDjvYaOwJf_VVtFIEuuKDQqQwf1oGxcl1yiz0O0gsOb3ZHSed7c3fiOAqtepCq3xa57J0a9dc9cY Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:02:22.294801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e84d820464c34a30bee606e1c7f711c9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 45ab0b2264a244a98f90769b266ccb3a Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.296037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'server_id': 'd0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d'} Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:02:22.296684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:22.297834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:22.299135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Returning 404 to user: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:02:22.299135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b15b91de-efa5-4cf8-8411-20f293df1f8c tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036408 Aug 31 07:02:22.299135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 73/137] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:02:22 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:02:23.045902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:23.046497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:23.052759 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:23.053555 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:23.054005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:23.054684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:23.055176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:23.055574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:23.248520 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:23.267420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7f8286e6-d77e-4891-956e-1aa457d1e4ee tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.216049 Aug 31 07:02:23.267420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 65/138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:23 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:24.284203 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:24.284810 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:24.291736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:24.292238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:24.292890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:24.293373 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:24.293981 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:24.294450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:24.439952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:24.447767 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fa3ca09b-bbfc-4599-84a8-273d053dad92 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.167353 Aug 31 07:02:24.448551 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 74/139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:24 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:25.469495 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:25.470112 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:25.477227 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:25.477738 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:25.478266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:25.479115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:25.479535 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:25.479954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:25.634578 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:25.640314 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:25.640816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:25.643461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d87aef0b-6f45-43b8-9102-ee6c1846b350 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.177817 Aug 31 07:02:25.645654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 66/140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:25 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:25.661180 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:25.661836 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:25.662821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:25.663483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:25.663927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:25.664339 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:25.684764 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] HTTP exception thrown: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Request method failure captured: Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: DELETE /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d HTTP/1.1 Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwc_yNnlBiz6HP97GcMg0QfeVFBbRCAQ5II7prncOYYfKoL0Vj5LbtSOqxpXngvgBg7qMJpS45-ESPxQGxkKB4JLtTCp_9r_shcnDjvYaOwJf_VVtFIEuuKDQqQwf1oGxcl1yiz0O0gsOb3ZHSed7c3fiOAqtepCq3xa57J0a9dc9cY Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:02:25.687662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e84d820464c34a30bee606e1c7f711c9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 45ab0b2264a244a98f90769b266ccb3a Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.689194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'd0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d'} Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:02:25.690066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.691842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.694751 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Returning 404 to user: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:02:25.695796 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1732b8be-6188-4f2c-bdea-9aeef6125076 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 404 len: 111 microversion: 2.1 time: 0.060375 Aug 31 07:02:25.696445 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 75/141] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:02:25 2022] DELETE /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 07:02:25.709185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:25.709979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] [instance: d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:25.716020 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:25.716528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:25.716959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:25.717643 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:25.718092 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:25.718605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:25.731916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] HTTP exception thrown: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Request method failure captured: Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d HTTP/1.1 Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc_yNnlBiz6HP97GcMg0QfeVFBbRCAQ5II7prncOYYfKoL0Vj5LbtSOqxpXngvgBg7qMJpS45-ESPxQGxkKB4JLtTCp_9r_shcnDjvYaOwJf_VVtFIEuuKDQqQwf1oGxcl1yiz0O0gsOb3ZHSed7c3fiOAqtepCq3xa57J0a9dc9cY Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:02:25.733436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e84d820464c34a30bee606e1c7f711c9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e84d820464c34a30bee606e1c7f711c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: e84d820464c34a30bee606e1c7f711c9 Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-DeleteServersTestJSON-169338827 Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 45ab0b2264a244a98f90769b266ccb3a Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-DeleteServersTestJSON-169338827-project Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.734925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'd0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d'} Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:02:25.735735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. Aug 31 07:02:25.737240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:02:25.738724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] Returning 404 to user: Instance d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:02:25.738724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3bac0250-2fdd-4c4d-a16c-8e28831eb7f6 tempest-DeleteServersTestJSON-169338827 tempest-DeleteServersTestJSON-169338827-project] 10.222.0.42 "GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d" status: 404 len: 111 microversion: 2.1 time: 0.029582 Aug 31 07:02:25.738724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 67/142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:25 2022] GET /compute/v2.1/servers/d0dd00a0-5445-41e3-b3a4-bf3f1ba9e34d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:02:26.669309 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:26.669911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:26.676436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:26.676920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:26.677348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:26.678031 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:26.678471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:26.678896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:26.926785 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:26.935067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-59ca7cf3-bb03-4864-81f5-e5847f20f933 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.269755 Aug 31 07:02:26.935781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 76/143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:26 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:27.164422 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-825421814", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:27.956211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:27.956767 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:27.962867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:27.963572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:27.964010 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:27.964715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:27.965174 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:27.965594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:28.426581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:28.434792 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5e6ffa78-1473-4ca8-b663-4b34b7bdff79 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.482544 Aug 31 07:02:28.435490 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 77/144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:27 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:29.456566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:29.457283 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:29.464060 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:29.464541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:29.464969 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:29.465633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:29.466075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:29.466473 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:29.612499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:29.621051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c229455b-7f1a-413a-9a0c-df3e9a56b062 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.168361 Aug 31 07:02:29.621796 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 78/145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:29 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:30.334839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] validate_networks() for None {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:02:30.643141 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:30.643758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:30.650294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:30.650779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:30.651239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:30.651945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:30.652556 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:30.653132 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:30.811020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:30.820966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2647b791-7157-413d-9849-e0f35f02cab9 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.181598 Aug 31 07:02:30.821546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 79/146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:30 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:30.868173 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:02:30.868602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:02:30.869070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:02:30.869471 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:02:30.869872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:02:30.878815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:30.879433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:30.879943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:30.880605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:30.881049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:30.881463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:30.898637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Getting quotas for project 431c7b8db0764532adebd65f2af361f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:02:30.902641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Getting quotas for user 31da2131e3884fbe9b584fd146c52beb and project 431c7b8db0764532adebd65f2af361f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:02:30.915080 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:02:30.917397 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:02:30.965571 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-269a287f-adf5-4fa6-8cc1-69911be711dd tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.805335 Aug 31 07:02:30.966840 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 68/147] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:02:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:02:30.979336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8bb56d84-91f3-4137-80af-01bb46c53c40 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:30.980220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8bb56d84-91f3-4137-80af-01bb46c53c40 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:31.108700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8bb56d84-91f3-4137-80af-01bb46c53c40 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:31.122255 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8bb56d84-91f3-4137-80af-01bb46c53c40 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1214 microversion: 2.1 time: 0.147826 Aug 31 07:02:31.122830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 80/148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:30 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:31.842363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:31.843106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:31.851168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:31.851865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:31.852442 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:31.853286 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:31.853881 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:31.854308 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:32.143274 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:32.143842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:32.150099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:32.150582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:32.151043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:32.151734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:32.152170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:32.152581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:32.175837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:32.197668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-35f85162-d420-4b29-b9b4-71d4896d342d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.359865 Aug 31 07:02:32.199735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 69/149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:31 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:32.246452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:32.254896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-320bafa6-e88f-4e57-bb46-3c55aefc7e4e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1266 microversion: 2.1 time: 0.115565 Aug 31 07:02:32.255471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 81/150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:32 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:33.221981 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:33.223356 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:33.233250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:33.233973 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:33.235466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:33.236340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:33.236960 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:33.237577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:33.276184 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:33.276926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:33.283308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:33.284000 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:33.284586 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:33.285459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:33.286053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:33.286868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:33.356374 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:33.364707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1020a8f2-c183-4539-8066-85bfad43b396 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1272 microversion: 2.1 time: 0.092261 Aug 31 07:02:33.365297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 82/151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:33 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:33.545006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:33.567713 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c127f1d8-5e1f-40af-85c1-70a80cdcbdcd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.345971 Aug 31 07:02:33.586104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 70/152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:33 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:34.385845 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:34.386450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:34.401336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:34.401899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:34.402395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:34.403169 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:34.403682 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:34.404110 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:34.589028 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:34.591816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:34.599048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:34.599821 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:34.600443 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:34.601360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:34.602055 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:34.602765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:34.658631 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:34.670200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d3f14ef5-a5b4-411c-9176-26732fbab17b tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.288254 Aug 31 07:02:34.692953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 83/153] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:34 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:34.874579 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:34.886417 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ed0afde9-b6bb-43d7-aef3-c47620e0bb44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.301077 Aug 31 07:02:34.888681 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 71/154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:34 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:35.529281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-832fc62d-bf17-4ee4-b6a4-097398d9a8b8 req-cca0870d-8ad1-4031-9175-a1432d055b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0b9426-d6d4-47f9-87ed-b71ef3062d8b", "tag": "51baa8e4-f071-4fce-a1e6-3e63072f4ba1"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:35.545998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-832fc62d-bf17-4ee4-b6a4-097398d9a8b8 req-cca0870d-8ad1-4031-9175-a1432d055b25 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:35.546480 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-832fc62d-bf17-4ee4-b6a4-097398d9a8b8 req-cca0870d-8ad1-4031-9175-a1432d055b25 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:35.546943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-832fc62d-bf17-4ee4-b6a4-097398d9a8b8 req-cca0870d-8ad1-4031-9175-a1432d055b25 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:35.583058 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-832fc62d-bf17-4ee4-b6a4-097398d9a8b8 req-cca0870d-8ad1-4031-9175-a1432d055b25 service nova] Creating event network-changed:51baa8e4-f071-4fce-a1e6-3e63072f4ba1 for instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b on hv-cinder-85528 Aug 31 07:02:35.590379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-832fc62d-bf17-4ee4-b6a4-097398d9a8b8 req-cca0870d-8ad1-4031-9175-a1432d055b25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064690 Aug 31 07:02:35.595754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 84/155] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:02:35.700298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:35.701678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:35.709599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:35.710307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:35.711105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:35.711850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:35.712448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:35.713036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:35.869933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:35.880498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-32baa2c8-db4e-4e83-a4d7-de227d5bec91 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.184119 Aug 31 07:02:35.881840 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 72/156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:35 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:35.909329 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:35.910400 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:35.917078 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:35.917764 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:35.918201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:35.918927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:35.919379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:35.919801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:36.350544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:36.382204 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-345d578c-a5de-4f94-ba73-2c4248070b53 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.477263 Aug 31 07:02:36.383176 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 85/157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:35 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:36.822757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b74b8272-5320-4eae-b482-74295127c4e8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: .version_select at 0x7ff9c0837b80>, body: {"keypair": {"name": "tempest-keypair-403923971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtMwZD4c4MWVFyX1hum1CXW0j/TMtQu3Jv3xgFSlz6s27GnNnK8vu6BYujRhX+NLOpxm8cQfiCAHwfO7h6qkCXVkvcD8QPC/5yuQi3PBVwoLNKJNGu18rHrpnW3a79+pw=="}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:36.843113 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-b74b8272-5320-4eae-b482-74295127c4e8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:02:36.847234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-b74b8272-5320-4eae-b482-74295127c4e8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:02:36.888068 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b74b8272-5320-4eae-b482-74295127c4e8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.193075 Aug 31 07:02:36.888914 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 73/158] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:02:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:02:36.904032 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:36.905173 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:36.912140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:36.912975 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:36.913395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:36.914266 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:36.914809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:36.915251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:36.934709 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:37.125165 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:37.133677 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bd1448f4-fa15-4e43-84ba-29ff45e093c3 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.233457 Aug 31 07:02:37.134289 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 86/159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:36 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:37.403397 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:37.404015 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:37.411339 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:37.411443 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:37.411983 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:37.413104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:37.413782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:37.414178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:37.659782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:37.669504 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1c563e97-ea7f-47e7-8bef-237a878225de tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.269983 Aug 31 07:02:37.670835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 74/160] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:37 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:38.157000 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:38.157565 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:38.159767 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=50 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:38.166052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:38.166760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:38.167453 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:38.168135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:38.169013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:38.169495 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:38.335807 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:38.343835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-715db9a3-5ac9-4721-88d0-8fcdffe848c7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.191555 Aug 31 07:02:38.344780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 87/161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:38 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:38.690884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1304749450", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d"}], "security_groups": [{"name": "tempest-securitygroup--1931046279"}], "key_name": "tempest-keypair-403923971", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:38.692049 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:38.693019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:38.700767 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:38.701697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:38.702146 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:38.703170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:38.703940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:38.704400 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:38.844203 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] validate_networks() for [('fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:02:38.890511 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:38.899434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f49cb585-58ee-479e-8a7f-7e2659ac2c36 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.211786 Aug 31 07:02:38.900331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 88/162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:38 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:39.379853 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:39.386105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:39.399014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:39.399582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:39.400036 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:39.401062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:39.401513 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:39.401932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:39.540161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:02:39.540582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:02:39.541052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:02:39.541458 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:02:39.541865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:02:39.556832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:39.557489 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:39.557926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:39.558646 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:39.559129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:39.559550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:39.587250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:02:39.592843 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:02:39.609398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:02:39.611626 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:02:39.623187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:39.633002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d7b69e68-b0bd-403e-858b-0299d096ee0c tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.259699 Aug 31 07:02:39.640115 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 89/163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:39 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:39.680550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-248388db-5adf-4cf1-9d40-06dc85d0fcc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.997550 Aug 31 07:02:39.694362 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-295d0f74-0f83-455a-92f8-8895dd03c003 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:39.695157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-295d0f74-0f83-455a-92f8-8895dd03c003 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:39.699442 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 75/164] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:02:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 07:02:39.779713 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-295d0f74-0f83-455a-92f8-8895dd03c003 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:39.808143 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-295d0f74-0f83-455a-92f8-8895dd03c003 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1241 microversion: 2.1 time: 0.102665 Aug 31 07:02:39.809507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 90/165] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:39 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:39.921707 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:39.922900 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:39.944135 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:39.944633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:39.945073 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:39.945794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:39.946246 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:39.946653 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:40.289872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:40.304918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-988b53af-ca0f-4e91-8d4a-b6828dd20973 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.382668 Aug 31 07:02:40.318396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 76/166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:39 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:40.656028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:40.656730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:40.669043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:40.669535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:40.669966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:40.670758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:40.671127 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:40.671545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:40.821511 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:40.829814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:40.830367 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3925a7d6-430c-4e12-b127-b2cf479c6eb2 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.178814 Aug 31 07:02:40.830814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 91/167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:40 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:40.831408 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:40.839569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:40.840278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:40.840864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:40.841714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:40.842301 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:40.842896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:40.846179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:40.912913 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:40.921393 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-42185c54-f223-4d5f-9b0d-ea0bcc73eee4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1245 microversion: 2.1 time: 0.095509 Aug 31 07:02:40.922309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 77/168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:40 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:41.330197 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:41.331230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:41.342038 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:41.342830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:41.343595 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:41.344719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:41.345510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:41.346342 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:41.485068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:41.495670 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5e638735-0987-4a3e-9d9c-86d0f12d9f70 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1520 microversion: 2.1 time: 0.171881 Aug 31 07:02:41.496447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 92/169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:41 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:41.852302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:41.852952 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:41.855354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:41.860627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:41.861103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:41.861530 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:41.862200 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:41.862642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:41.863156 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:41.943773 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:41.944494 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:41.951283 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:41.951702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:41.952120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:41.952806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:41.953246 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:41.953655 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:42.007215 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:42.023680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a7b7e1f4-b339-4915-adc5-1dd91092188f tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.166749 Aug 31 07:02:42.024968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:42.025425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 78/170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:41 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:42.032868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7ba66015-07c9-4ba0-8cb6-7a6ce5886cab tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1245 microversion: 2.1 time: 0.093631 Aug 31 07:02:42.033707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 93/171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:41 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:42.516550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:42.517157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:42.523511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:42.524016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:42.524432 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:42.525123 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:42.525644 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:42.526065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:42.664188 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:42.672131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0847f0cb-43e0-44d8-98e2-dd0a359a2cda tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1500 microversion: 2.1 time: 0.159478 Aug 31 07:02:42.672704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 79/172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:42 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:42.691905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:42.693169 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:42.699851 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:42.700434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:42.701077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:42.701968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:42.702413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:42.702824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:42.840893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:42.851322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5c2c98a5-3b8d-416a-8df7-c4c703836d44 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1514 microversion: 2.1 time: 0.163179 Aug 31 07:02:42.852579 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 94/173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:42 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:43.056213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:43.056891 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:43.057527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:43.058136 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:43.067487 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:43.069377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:43.069874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:43.071307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:43.072171 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:43.072588 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:43.072986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:43.073915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:43.074553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:43.075212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:43.075785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:43.076686 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:43.159488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:43.168729 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2154966d-9265-407d-9cc3-54faf477725d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1311 microversion: 2.1 time: 0.117523 Aug 31 07:02:43.170348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 95/174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:43 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:43.353639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:43.362257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0555d139-f89b-4315-aab2-8f9d38f1a0d6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.313931 Aug 31 07:02:43.363183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 80/175] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:43 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:44.197591 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:44.198298 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:44.225081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.225654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.226158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.227002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.227450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.228051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.381801 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:44.384172 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:44.391442 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.392089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.392669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.393532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.394118 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.394705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.415844 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:44.425973 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-58a19c1b-5202-4947-83f1-5ff79e611a9f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.238606 Aug 31 07:02:44.430088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lazy-loading 'flavor' on Instance uuid 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:02:44.432417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 96/176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:44 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:44.437739 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:44.438590 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:44.446122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.446917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.447840 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.448819 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.449467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.450083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.565449 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cb35c984-b863-4676-8f3f-2e54e147dd7c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e/action" status: 200 len: 32 microversion: 2.1 time: 0.187666 Aug 31 07:02:44.566712 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 81/177] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:02:44 2022] POST /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 07:02:44.578423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:44.579488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:44.586883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.587442 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.588289 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.591111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:44.591779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:44.592233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:44.607594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:44.615652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e75f8f0f-2293-4f0c-88e5-4eb743adbd92 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.181959 Aug 31 07:02:44.616405 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 97/178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:44 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:44.748623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:44.764463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b60742f8-7b79-456c-aced-dce572ef0a25 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.191898 Aug 31 07:02:44.765207 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 82/179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:44 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:45.457498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:45.458450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:45.465055 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:45.465666 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:45.466111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:45.466824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:45.467301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:45.467740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:45.600334 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:45.608322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0d35396e-2f00-483e-b332-ec04f4018c76 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.157546 Aug 31 07:02:45.608893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 98/180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:45 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:45.638778 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:45.639918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:45.649503 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:45.650275 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:45.650796 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:45.651549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:45.652254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:45.652890 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:45.785264 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:45.785839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:45.786529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:45.798293 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:45.798983 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:45.799625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:45.799804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9cf4891a-5578-4abd-8620-a01d090a43e6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.161402 Aug 31 07:02:45.800469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:45.800586 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 83/181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:45 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:45.800911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:45.801489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:45.936489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:45.944533 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fdd9814d-15ad-448a-99de-4d043fbb8313 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.162747 Aug 31 07:02:45.945081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 99/182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:45 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:46.633840 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:46.634832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:46.645566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:46.646351 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:46.646651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:46.647364 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:46.647816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:46.648231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:46.791872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:46.803636 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cfdff670-df1d-4d0b-a62b-4511a3ac0878 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.176442 Aug 31 07:02:46.804198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 84/183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:46 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:46.821341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:46.821954 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:46.828133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:46.828613 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:46.829074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:46.829761 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:46.830205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:46.830602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:46.972567 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:46.973482 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:46.975656 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:46.984421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:46.985774 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:46.986515 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:46.987415 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:46.988034 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:46.988599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:46.992228 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-53e1cd2c-bbca-46f4-9710-356f799af0b6 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.174760 Aug 31 07:02:46.993510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 100/184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:46 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:47.332835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:47.341781 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-73b76274-a55d-4caa-962e-f2089ab39a84 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.377761 Aug 31 07:02:47.343068 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 85/185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:46 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:47.824779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:47.825451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:47.831758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:47.832253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:47.832693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:47.834489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:47.834944 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:47.835378 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:47.994243 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:48.005399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6ddc9fe5-7dcd-4450-8315-280d5e53305c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.184740 Aug 31 07:02:48.023683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 101/186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:47 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:48.030800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:48.032072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:48.039897 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-4f9cb630-a959-44dd-9b82-b412c4af4b7c req-ff2c64fb-d80c-4d86-8699-a74dc16e970b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90e4773-c53c-4ed4-b224-f6763afc33d9", "tag": "f53976a2-25d6-4a1c-9f42-fe424e928a99"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:48.040135 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:48.040814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:48.041428 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:48.042277 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:48.056056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:48.058194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:48.065669 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-4f9cb630-a959-44dd-9b82-b412c4af4b7c req-ff2c64fb-d80c-4d86-8699-a74dc16e970b service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:48.066821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-4f9cb630-a959-44dd-9b82-b412c4af4b7c req-ff2c64fb-d80c-4d86-8699-a74dc16e970b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:48.067543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-4f9cb630-a959-44dd-9b82-b412c4af4b7c req-ff2c64fb-d80c-4d86-8699-a74dc16e970b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:48.081328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-4f9cb630-a959-44dd-9b82-b412c4af4b7c req-ff2c64fb-d80c-4d86-8699-a74dc16e970b service nova] Creating event network-changed:f53976a2-25d6-4a1c-9f42-fe424e928a99 for instance c90e4773-c53c-4ed4-b224-f6763afc33d9 on hv-cinder-85528 Aug 31 07:02:48.089021 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-4f9cb630-a959-44dd-9b82-b412c4af4b7c req-ff2c64fb-d80c-4d86-8699-a74dc16e970b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053512 Aug 31 07:02:48.089905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 102/187] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:02:48.267811 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:48.275873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-376d3b36-1a3c-4f00-8c13-ee9651f6a338 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.252561 Aug 31 07:02:48.276450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 86/188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:48 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:48.364802 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:48.366043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:48.373189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:48.373723 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:48.374303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:48.375125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:48.375699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:48.376116 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:48.533295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:48.541505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-605ec1a9-a8c8-44d8-8471-76d70f827404 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.181993 Aug 31 07:02:48.542077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 103/189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:48 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:49.029749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:49.030399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:49.037041 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:49.037996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:49.038283 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:49.039011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:49.039458 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:49.039877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:49.182447 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:49.197749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4940d644-529e-4676-a1ac-3c8ee16e1d5d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.171873 Aug 31 07:02:49.198328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 87/190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:49 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:49.297178 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:49.297790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:49.305102 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:49.305781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:49.306393 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:49.307453 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:49.308061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:49.308645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:49.357108 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-d9456427-9157-49b8-9121-308398df32c5 req-9b76030d-e9a2-47bd-9a09-33eec36c1ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0b9426-d6d4-47f9-87ed-b71ef3062d8b", "name": "network-vif-plugged", "status": "completed", "tag": "51baa8e4-f071-4fce-a1e6-3e63072f4ba1"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:49.377384 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-d9456427-9157-49b8-9121-308398df32c5 req-9b76030d-e9a2-47bd-9a09-33eec36c1ad7 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:49.377883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-d9456427-9157-49b8-9121-308398df32c5 req-9b76030d-e9a2-47bd-9a09-33eec36c1ad7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:49.378306 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-d9456427-9157-49b8-9121-308398df32c5 req-9b76030d-e9a2-47bd-9a09-33eec36c1ad7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:49.393750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-d9456427-9157-49b8-9121-308398df32c5 req-9b76030d-e9a2-47bd-9a09-33eec36c1ad7 service nova] Creating event network-vif-plugged:51baa8e4-f071-4fce-a1e6-3e63072f4ba1 for instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b on hv-cinder-85528 Aug 31 07:02:49.399149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-d9456427-9157-49b8-9121-308398df32c5 req-9b76030d-e9a2-47bd-9a09-33eec36c1ad7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045517 Aug 31 07:02:49.400069 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 88/191] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:02:49.475493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:49.479415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:49.484298 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7647a812-731c-4550-895d-e30722ac8fe7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.191304 Aug 31 07:02:49.484787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 104/192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:49 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:49.563608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:49.564834 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:49.572688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=4 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:49.575676 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:49.576689 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:49.577760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:49.578629 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:49.579395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:49.580651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:49.607541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=16 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:49.734500 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:49.742567 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a53be2fa-cb16-4011-aacb-3e07bfc851d6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.183751 Aug 31 07:02:49.743229 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 89/193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:49 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:50.222907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:50.223774 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:50.226275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=4 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:50.231823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:50.232299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:50.232724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:50.233382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:50.233838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:50.234244 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:50.376584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:50.385188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-750ac557-ca29-4254-bab2-f55a1d3504e0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.167981 Aug 31 07:02:50.386887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 105/194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:50 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:50.508074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:50.508722 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:50.515903 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:50.516382 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:50.516869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:50.517559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:50.518008 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:50.518425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:50.663230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:50.674207 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0f70f4f7-6caa-426a-9749-88d25a126f73 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.170287 Aug 31 07:02:50.674785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 90/195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:50 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:50.765082 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:50.765693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:50.772673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:50.773153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:50.773584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:50.774270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:50.774721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:50.775172 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:50.909322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:50.917685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fe5dd8e2-1f17-4d82-b130-91967aebfac4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.156559 Aug 31 07:02:50.918301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 106/196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:50 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:51.413446 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:51.414453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:51.424793 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:51.425582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:51.426831 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:51.427564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:51.428193 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:51.428654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:51.567104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:51.575926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3ac1b063-b2fb-4d80-8f2c-8116d5e2c81d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.169427 Aug 31 07:02:51.576474 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 91/197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:51 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:51.697531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:51.698201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:51.704570 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:51.705023 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:51.705520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:51.706215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:51.706671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:51.707118 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:51.842197 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:51.853533 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-413aa0d8-72ab-42e1-8a09-85a3958b6b3e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.160083 Aug 31 07:02:51.854342 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 107/198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:51 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:51.939599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:51.940330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:51.954268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:51.954890 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:51.955496 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:51.956303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:51.956881 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:51.957761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:51.974446 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:02:52.098823 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:52.108523 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a115f125-ddd7-4b8f-9080-b396e7c6a2fc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.172797 Aug 31 07:02:52.109320 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 92/199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:51 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:52.601024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:52.601983 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:52.612251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:52.613046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:52.613763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:52.614924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:52.615644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:52.616167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:52.768340 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:52.776758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c6308098-e7d5-48f1-965e-3b7a3a52ce9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.182257 Aug 31 07:02:52.777337 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 108/200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:52 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:52.877961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:52.878597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:52.885392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:52.885861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:52.886289 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:52.886996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:52.887411 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:52.887825 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:53.024482 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:53.032542 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-08e9b151-27a2-4d78-90cc-4a1ee2f40f23 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.158550 Aug 31 07:02:53.033096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 93/201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:52 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:53.129814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:53.130415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:53.136873 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:53.137351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:53.137777 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:53.138452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:53.138919 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:53.139335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:53.279741 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:53.288433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7e70dc9e-f96d-437d-9f7c-5ca5ab6f79a6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.162160 Aug 31 07:02:53.289105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 109/202] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:53 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:53.798111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:53.798754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:53.805369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:53.805866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:53.806293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:53.807023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:53.807472 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:53.807915 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:53.941644 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:53.952858 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9a7f7668-b0e3-4761-a0fa-d1c8dce5ba85 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.158352 Aug 31 07:02:53.953623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 94/203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:53 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:54.055265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:54.055643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:54.061598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:54.062072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:54.062517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:54.063240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:54.063689 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:54.064108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:54.203045 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:54.211217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-36e5df22-e895-4c08-bf59-4b843cb85282 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1314 microversion: 2.1 time: 0.160152 Aug 31 07:02:54.211710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 110/204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:54 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:54.312220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:54.312961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:54.321486 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:54.321975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:54.322403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:54.323122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:54.323603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:54.324016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:54.463017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:54.471683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ccf591cc-b24f-4203-80f1-b9a44e2ba28f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.165180 Aug 31 07:02:54.472261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 95/205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:54 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:54.981779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:54.982386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:54.988629 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:54.989135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:54.989560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:54.990248 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:54.990702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:54.991152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.130190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:55.138466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-deec5521-e05f-4b39-9250-9bce0bb62b73 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.160594 Aug 31 07:02:55.139226 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 111/206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:54 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:55.236575 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:55.237168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:55.248292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.248984 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.249465 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.250162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.250604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.251413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.393187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-b352633b-57da-4673-b047-f0839017433c req-437eb07d-323f-4b39-b953-2c97c23bf71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90e4773-c53c-4ed4-b224-f6763afc33d9", "name": "network-vif-plugged", "status": "completed", "tag": "f53976a2-25d6-4a1c-9f42-fe424e928a99"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:55.404900 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-b352633b-57da-4673-b047-f0839017433c req-437eb07d-323f-4b39-b953-2c97c23bf71c service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.405755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-b352633b-57da-4673-b047-f0839017433c req-437eb07d-323f-4b39-b953-2c97c23bf71c service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.406375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-b352633b-57da-4673-b047-f0839017433c req-437eb07d-323f-4b39-b953-2c97c23bf71c service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.407911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:55.421758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-b352633b-57da-4673-b047-f0839017433c req-437eb07d-323f-4b39-b953-2c97c23bf71c service nova] Creating event network-vif-plugged:f53976a2-25d6-4a1c-9f42-fe424e928a99 for instance c90e4773-c53c-4ed4-b224-f6763afc33d9 on hv-cinder-85528 Aug 31 07:02:55.422159 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-be01d1da-89f1-4fe7-ae52-2937d851a6f7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1464 microversion: 2.1 time: 0.189664 Aug 31 07:02:55.423128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 96/207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:55 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:55.428596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-b352633b-57da-4673-b047-f0839017433c req-437eb07d-323f-4b39-b953-2c97c23bf71c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Aug 31 07:02:55.430280 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 112/208] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:02:55.478204 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:55.478204 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:55.487917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.488416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.495469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.496618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:55.497730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:55.506245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.506739 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.507201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.508853 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.509518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.509696 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.510347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.510794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.511363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.566085 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:02:55.671995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b4f948b5-0bac-45b4-835a-442ea3f71794 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 204 len: 0 microversion: 2.1 time: 0.198625 Aug 31 07:02:55.686993 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 97/209] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:02:55 2022] DELETE /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:02:55.695014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:55.695967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:55.704100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.704773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.705331 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.705899 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:55.706473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:55.707420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:55.725771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:55.734675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0225d7c8-ac37-40fe-abc0-c4a138c6a017 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.244448 Aug 31 07:02:55.736218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 113/210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:55 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:55.858780 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:55.866744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d3541557-c363-4ac6-8cca-37a99c917dc0 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1470 microversion: 2.1 time: 0.178367 Aug 31 07:02:55.867426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 98/211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:55 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:56.160057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:56.161292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:56.170288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:56.171079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:56.171717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:56.172634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:56.173410 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:56.174001 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:56.355212 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:56.364433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-45d47b31-06e3-48a4-bb7d-44eb5060eb94 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.209100 Aug 31 07:02:56.365104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 114/212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:56 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:56.756693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:56.757324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:56.766402 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:56.766930 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:56.767365 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:56.768076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:56.768524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:56.768992 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:56.892744 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:56.893654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:56.901450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:56.902498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:56.903193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:56.904079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:56.904710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:56.905402 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:56.948015 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:56.955838 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dda72953-6748-45ca-9b72-6ef5410e9600 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.203364 Aug 31 07:02:56.957519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 99/213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:56 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:57.092033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:57.108043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ce93d066-17ef-4b3c-a704-2adb4c8a9c5a tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1470 microversion: 2.1 time: 0.221715 Aug 31 07:02:57.108043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 115/214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:56 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:57.396027 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:57.397012 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:57.404411 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:57.405129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:57.405566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:57.406698 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:57.407306 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:57.409169 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:57.780789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:57.804341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-64f51614-cc3b-433b-b62a-0d4a9a2ab144 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.414550 Aug 31 07:02:57.814814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 100/215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:57 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:57.980890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:57.981508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:57.987901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:57.988474 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:57.988910 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:57.989608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:57.990184 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:57.990606 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:58.128498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:58.129238 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:58.131144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:58.136425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:58.136907 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:58.137312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:58.138001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:58.138444 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:58.138881 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:58.139277 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4b358a18-8599-432c-971d-95731cdb7a11 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.166034 Aug 31 07:02:58.139854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 116/216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:57 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:58.310715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:58.318696 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4a796084-e251-44d5-8675-060008cb3764 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1470 microversion: 2.1 time: 0.194344 Aug 31 07:02:58.319324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 101/217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:58 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:02:58.797662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-2130c3b8-4f4a-45a2-b78b-4c02ecedad67 req-95f1b28c-6649-47ee-a6b3-65d4b3be4482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0b9426-d6d4-47f9-87ed-b71ef3062d8b", "name": "network-vif-deleted", "tag": "51baa8e4-f071-4fce-a1e6-3e63072f4ba1"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:02:58.808017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2130c3b8-4f4a-45a2-b78b-4c02ecedad67 req-95f1b28c-6649-47ee-a6b3-65d4b3be4482 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:58.808499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2130c3b8-4f4a-45a2-b78b-4c02ecedad67 req-95f1b28c-6649-47ee-a6b3-65d4b3be4482 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:58.808931 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2130c3b8-4f4a-45a2-b78b-4c02ecedad67 req-95f1b28c-6649-47ee-a6b3-65d4b3be4482 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:58.821356 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-2130c3b8-4f4a-45a2-b78b-4c02ecedad67 req-95f1b28c-6649-47ee-a6b3-65d4b3be4482 service nova] Creating event network-vif-deleted:51baa8e4-f071-4fce-a1e6-3e63072f4ba1 for instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b on hv-cinder-85528 Aug 31 07:02:58.826679 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-2130c3b8-4f4a-45a2-b78b-4c02ecedad67 req-95f1b28c-6649-47ee-a6b3-65d4b3be4482 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032708 Aug 31 07:02:58.827634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 117/218] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:02:58.832722 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:58.833454 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:58.840681 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:58.841410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:58.841998 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:58.843013 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:58.843618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:58.844198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:59.022617 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:59.031448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cef92de9-4b72-4e07-9ec0-195161efcaa9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.207309 Aug 31 07:02:59.032019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 102/219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:58 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:59.162555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:59.163718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:59.173022 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:59.173675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:59.174224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:59.175292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:59.175939 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:59.176474 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:59.325366 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:59.333863 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5657f806-6e15-4dc2-9754-39d51d961688 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.176800 Aug 31 07:02:59.334430 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 118/220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:59 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:02:59.340480 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:02:59.341103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:02:59.347185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:59.347662 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:59.348087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:59.348770 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:02:59.349214 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:02:59.349627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:02:59.416414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:02:59.424355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7c56c523-10b8-4d30-a452-1fc549a6840e tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1428 microversion: 2.1 time: 0.087891 Aug 31 07:02:59.424937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 103/221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:02:59 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:00.054288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:00.054876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:00.061390 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:00.061880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:00.062298 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:00.063013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:00.063461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:00.063883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:00.197067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:00.204945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-15399643-5501-4e67-9fb4-4416356d5da0 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.154640 Aug 31 07:03:00.205599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 119/222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:00 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:00.358755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:00.359822 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:00.371365 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:00.372125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:00.372854 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:00.373975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:00.374716 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:00.375462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:00.445770 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:00.447048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:00.453786 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:00.454356 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:00.454831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:00.455731 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:00.456188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:00.456806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:00.511909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:00.520216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-31c4f228-5fc1-4d29-a673-35799143b145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.168004 Aug 31 07:03:00.520756 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 104/223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:00 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:00.523561 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:00.531652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ff688f3e-0b82-4a1e-80ab-387cfb04c1f9 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1428 microversion: 2.1 time: 0.089863 Aug 31 07:03:00.532215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 120/224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:00 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:01.225667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:01.226438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:01.233642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:01.234137 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:01.234569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:01.235296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:01.236148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:01.236148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:01.400633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:01.409140 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dba2624c-d150-46fc-8006-9f4ac18145c6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1367 microversion: 2.1 time: 0.187310 Aug 31 07:03:01.409715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 105/225] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:01 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:01.541665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:01.542302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:01.548797 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:01.549363 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:01.549710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:01.550399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:01.550867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:01.551295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:01.553379 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:01.553988 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:01.560341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:01.560930 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:01.561377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:01.562110 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:01.562579 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:01.563026 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:01.629178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da2131e3884fbe9b584fd146c52beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431c7b8db0764532adebd65f2af361f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:01.638030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bbc98019-fd54-461a-a422-4ad7e73fccd7 tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 200 len: 1428 microversion: 2.1 time: 0.088315 Aug 31 07:03:01.638585 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 106/226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:01 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:01.686810 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:01.695255 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1f779dba-5cdd-496b-bf72-6c7a03a82903 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.158034 Aug 31 07:03:01.695833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 121/227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:01 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:02.430211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:02.430994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:02.437767 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.438262 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.438668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.439472 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.439924 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.440342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.456710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:02.583522 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:02.591761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5a88c1f4-89d6-4415-b298-98b71d96e529 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1557 microversion: 2.1 time: 0.165435 Aug 31 07:03:02.592811 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 107/228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:02 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:02.613488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:02.614079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:02.619809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.620280 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.620752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.621491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.621943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.622377 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.659291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:02.659894 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] [instance: 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:02.666915 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.667455 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.667911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.668603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.669050 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.669462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.683149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] HTTP exception thrown: Instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b could not be found. Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Request method failure captured: Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b HTTP/1.1 Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweBbIPqcphI8DZ_VTS-72NFJZit1X-z7RG6z38bIvU5To4ChaCWbpq17m4bqHYGXLC_c5glHph667jkYH9HFKpKNu0T8UscP0rk-cTx6Bfw5TW_1E9YofSiwa1BDSPnGB6xGMGnxGX0IC3G1oJe-OZ24ZKi99Z8uS6vgTYxTzyJdeM Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 431c7b8db0764532adebd65f2af361f3 Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-VolumesNegativeTest-1687708280 Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:03:02.685089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/431c7b8db0764532adebd65f2af361f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/431c7b8db0764532adebd65f2af361f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_431c7b8db0764532adebd65f2af361f3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/431c7b8db0764532adebd65f2af361f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-VolumesNegativeTest-1687708280 Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 431c7b8db0764532adebd65f2af361f3 Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-VolumesNegativeTest-1687708280 Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-VolumesNegativeTest-1687708280-project Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 31da2131e3884fbe9b584fd146c52beb Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-VolumesNegativeTest-1687708280-project Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b could not be found. Aug 31 07:03:02.686464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '4e0b9426-d6d4-47f9-87ed-b71ef3062d8b'} Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b could not be found. Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:03:02.687199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b could not be found. Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b could not be found. Aug 31 07:03:02.688366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:03:02.689373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] Returning 404 to user: Instance 4e0b9426-d6d4-47f9-87ed-b71ef3062d8b could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:03:02.689373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-489d8eac-7f44-4a99-b433-26b129a2859d tempest-VolumesNegativeTest-1687708280 tempest-VolumesNegativeTest-1687708280-project] 10.222.0.42 "GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b" status: 404 len: 111 microversion: 2.1 time: 0.031273 Aug 31 07:03:02.689373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 108/229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:02 2022] GET /compute/v2.1/servers/4e0b9426-d6d4-47f9-87ed-b71ef3062d8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:03:02.704788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0289e03f-e1e2-42bf-9977-9d0dea41e5e2 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095408 Aug 31 07:03:02.705531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 122/230] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:03:02 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:03:02.718979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:02.719639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:02.725816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.726298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.726721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.727604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:02.728101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:02.728751 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:02.878868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:02.890525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bcee6b9a-b094-4f32-a085-8f5bed943c65 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.175707 Aug 31 07:03:02.891387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 109/231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:02 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:03.914594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:03.915771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:03.922163 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:03.922937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:03.923550 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:03.924422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:03.924858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:03.925460 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:03.929872 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:04.158697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:04.172677 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-aebb5f38-c271-4b6a-b31f-7ace1d809d6a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.262287 Aug 31 07:03:04.173825 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 123/232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:03 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:04.176457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-1cd9894c-ab3b-4038-81de-72ba8556d910 req-e52b03d2-8701-4ac1-85a6-23872c2ab9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90e4773-c53c-4ed4-b224-f6763afc33d9", "tag": "f53976a2-25d6-4a1c-9f42-fe424e928a99"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:04.200242 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-1cd9894c-ab3b-4038-81de-72ba8556d910 req-e52b03d2-8701-4ac1-85a6-23872c2ab9e4 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:04.200242 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-1cd9894c-ab3b-4038-81de-72ba8556d910 req-e52b03d2-8701-4ac1-85a6-23872c2ab9e4 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:04.200688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-1cd9894c-ab3b-4038-81de-72ba8556d910 req-e52b03d2-8701-4ac1-85a6-23872c2ab9e4 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:04.212352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-1cd9894c-ab3b-4038-81de-72ba8556d910 req-e52b03d2-8701-4ac1-85a6-23872c2ab9e4 service nova] Creating event network-changed:f53976a2-25d6-4a1c-9f42-fe424e928a99 for instance c90e4773-c53c-4ed4-b224-f6763afc33d9 on hv-cinder-85528 Aug 31 07:03:04.218740 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-1cd9894c-ab3b-4038-81de-72ba8556d910 req-e52b03d2-8701-4ac1-85a6-23872c2ab9e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048029 Aug 31 07:03:04.219429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 110/233] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:03:05.194188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:05.195459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:05.202828 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:05.203650 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:05.204239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:05.205366 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:05.205967 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:05.206765 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:05.362194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:05.370068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4aa40282-54a2-486b-a27f-cbca0d44bb82 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.180401 Aug 31 07:03:05.370629 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 124/234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:05 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:06.392736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:06.393528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:06.400010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:06.400553 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:06.401007 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:06.401720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:06.402341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:06.402926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:06.546979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:06.555044 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e408f3af-39b2-4b20-a2c9-c04e41bdd375 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.167583 Aug 31 07:03:06.555660 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 111/235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:06 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:07.576359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:07.576959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:07.585017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:07.585690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:07.586302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:07.587297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:07.587911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:07.589116 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:07.735267 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:07.744444 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f37bda6c-e03f-4859-9a05-72b4c03967fd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.171961 Aug 31 07:03:07.745023 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 125/236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:07 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:08.676709 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:08.677407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:08.687612 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:08.688282 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:08.689231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:08.690220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:08.690720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:08.691559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:08.731963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4742c78c-364f-4a36-9b05-36dfdc8481f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/ips" status: 200 len: 153 microversion: 2.20 time: 0.059532 Aug 31 07:03:08.732584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 112/237] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 31 07:03:08 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/ips => generated 153 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:03:08.768966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:08.769565 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:08.775843 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=80 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:08.777990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:08.778781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:08.779445 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:08.780292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:08.780980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:08.781547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:09.073101 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:09.088964 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2e932646-ee90-4c70-9480-709c37709e22 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.322301 Aug 31 07:03:09.104460 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 126/238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:08 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:10.117332 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:10.118694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:10.145589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:10.149029 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:10.153358 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:10.155754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:10.157136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:10.158794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:10.511439 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:10.521437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-013fcc3e-7eea-4b3b-8c02-d2dbdd563dc8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.412663 Aug 31 07:03:10.536404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 113/239] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:10 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:10.881643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:10.882172 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:10.894409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:10.895012 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:10.897257 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:10.898397 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:10.903145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:10.903812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:10.952404 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lazy-loading 'flavor' on Instance uuid 511f1298-6885-4659-86c4-2bb83fa7803b {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:03:11.238988 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-afdd265a-c553-4489-950d-58dbd18e0fa6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/action" status: 202 len: 0 microversion: 2.20 time: 0.364573 Aug 31 07:03:11.239835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 127/240] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 07:03:10 2022] POST /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:03:11.250977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:11.254165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:11.269630 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:11.270701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:11.273667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:11.274622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:11.275266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:11.275853 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:11.547603 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:11.548297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:11.563281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:11.577199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:11.578867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:11.581011 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:11.584249 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:11.585645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:11.667281 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:11.688529 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:11.693210 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:11.695928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4aa55caf-f7f4-4df5-9907-7b7cf162f3ee tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.451519 Aug 31 07:03:11.718661 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 114/241] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:11 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:11.728729 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-365240139", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "networks": [{"uuid": "5f7a7893-0580-45a3-a56f-f043fba77ea0"}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:11.825554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] validate_networks() for [('5f7a7893-0580-45a3-a56f-f043fba77ea0', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:03:12.144500 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:12.159642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-491daf9b-7cb0-4d57-846a-1113128e3dd6 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.616776 Aug 31 07:03:12.173618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 128/242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:11 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:12.551248 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:03:12.552610 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:03:12.553395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:03:12.553899 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:03:12.554712 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:03:12.562164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:12.571528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:12.572455 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:12.573281 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:12.574987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:12.575781 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:12.576540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:12.601638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Getting quotas for project f1c80a72cf6844c3afd353461c55e580. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:12.607972 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Getting quotas for user 317bddaf96694853b3e029b2d23af87f and project f1c80a72cf6844c3afd353461c55e580. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:12.623654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:03:12.626995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:03:12.729317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:12.729940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:12.732904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a2594b50-503f-49b9-ae99-879bb847b52d tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012722 Aug 31 07:03:12.733565 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 115/243] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:03:12.740830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:12.744061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:12.744608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:12.745541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:12.746185 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:12.748438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:12.750354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c2fce86c-264d-4c8f-ba6b-759897baea17 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:12.751303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c2fce86c-264d-4c8f-ba6b-759897baea17 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:12.902197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c2fce86c-264d-4c8f-ba6b-759897baea17 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:12.911976 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c2fce86c-264d-4c8f-ba6b-759897baea17 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1218 microversion: 2.1 time: 0.170975 Aug 31 07:03:12.912493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 116/244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:12 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:13.064209 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:13.075678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:13.083980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:13.085434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fb17e9f8-94d7-41c9-bba7-2a56ca963fbb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.364295 Aug 31 07:03:13.090408 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 129/245] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:12 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:13.181889 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:13.183030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:13.190030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.191968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.194206 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.197688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.198435 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.201568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.581431 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:13.593577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-21443b41-09a6-4c39-a82c-94419bcaebc4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1500 microversion: 2.1 time: 0.415426 Aug 31 07:03:13.595527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 117/246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:13 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1500 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:13.617270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60ad0c47-a9f9-46cf-8d2d-0a18ff4b6c4b"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:13.619937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:13.632561 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.635324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.636026 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.638286 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.639260 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.640046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.677896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] HTTP exception thrown: Cannot 'attach_volume' instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e while it is in vm_state rescued Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Request method failure captured: Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: POST /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e/os-volume_attachments HTTP/1.1 Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 74 Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwc73vfOJKsuo-lE0dkRXVMK2NY8gbtDnNYwTIseD9r9rdZF_JTTzb15NFSpIWLF9lhaSgQ5FLNKJ9e_C2MiVjXG6VZvk_NzU_EK_TGb378NDvuxSdhgk0R6mf1yu8GqR04SjBB6A9dhsxuE_iRZ0E1q4-SGrZiZqqFElHloC_NTpfA Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:03:13.679947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a83fcf85c5fc44e396c97573a73f675a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 8b9c07381f404ec39a06e01ff890da5e Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {"volumeAttachment": {"volumeId": "60ad0c47-a9f9-46cf-8d2d-0a18ff4b6c4b"}} Aug 31 07:03:13.681276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Cannot 'attach_volume' instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e while it is in vm_state rescued Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'server_id': '842ba2ac-ef4a-4dd0-8945-a6c32c24d16e', 'body': {'volumeAttachment': {'volumeId': '60ad0c47-a9f9-46cf-8d2d-0a18ff4b6c4b'}}} Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:03:13.682013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e while it is in vm_state rescued Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:03:13.683220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:03:13.684359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:03:13.684359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:03:13.684359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e while it is in vm_state rescued Aug 31 07:03:13.684359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:03:13.686181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Returning 409 to user: Cannot 'attach_volume' instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e while it is in vm_state rescued {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:03:13.687569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-41b68496-c96d-408c-b3dd-4c882f6eec8c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074677 Aug 31 07:03:13.692064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 130/247] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:03:13 2022] POST /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 07:03:13.697395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:13.697912 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:13.705377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.706186 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.706803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.707836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.708493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.708921 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.797264 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2e41707c-0c70-41d7-b040-23626b718a5a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e/action" status: 202 len: 0 microversion: 2.1 time: 0.103671 Aug 31 07:03:13.802562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 118/248] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:03:13 2022] POST /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 07:03:13.810559 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:13.811883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:13.820659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.821694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.822370 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.824525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.825725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.826518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.933775 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:13.934538 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:13.943587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.944079 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.947139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:13.951343 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:13.952557 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:13.953148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:14.094206 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:14.115909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c068f31b-10d7-4f55-ab50-6cb7e20ba6d6 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1214 microversion: 2.1 time: 0.186512 Aug 31 07:03:14.137324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 119/249] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:13 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:14.143545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:14.144963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:14.148549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:14.152942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:14.154326 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:14.155102 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:14.161703 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:14.163499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b64df871-b2bf-472a-acea-89ba4385297f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 0.358754 Aug 31 07:03:14.164225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:14.164857 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:14.169923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 131/250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:13 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:14.705724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:14.718755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:14.720772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:14.728011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e316d251-72b4-4700-bb40-808646a43a3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.589013 Aug 31 07:03:14.728779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 120/251] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:14 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:15.142754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:15.143319 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:15.168444 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:15.168952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:15.169722 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:15.170454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:15.170932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:15.171572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:15.203306 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:15.207268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:15.231805 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:15.232549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:15.233173 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:15.234061 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:15.236271 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:15.236877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:15.532543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:15.544987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5ab21299-3347-4693-b978-3823c807bf6d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 0.355238 Aug 31 07:03:15.544987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 121/252] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:15 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:15.756856 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:15.758758 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:15.765921 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:15.766658 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:15.767362 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:15.768840 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:15.769467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:15.770037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:15.812111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:15.820792 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8f31e78b-ceba-4854-a776-e5cb3c2808f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1214 microversion: 2.1 time: 0.684188 Aug 31 07:03:15.836052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 132/253] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:15 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1214 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:16.061751 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:16.089002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:16.091415 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:16.093559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9259c1a0-1070-4487-9a7b-02b9947d6edc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.341394 Aug 31 07:03:16.094475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 122/254] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:15 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:16.563155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:16.564387 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:16.585826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:16.586423 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:16.586749 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:16.587493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:16.587923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:16.588348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:16.860373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:16.860986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:16.886645 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:16.887957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:16.888404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:16.889133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:16.889706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:16.890000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:16.990953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:17.001531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-232ef3a6-7b7d-4f35-8e93-dd338b46b1ea tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 0.442637 Aug 31 07:03:17.003430 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 133/255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:16 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:17.049109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:17.057423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ffe84fc9-26ce-482f-a4dd-e72a78270d64 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1270 microversion: 2.1 time: 0.204952 Aug 31 07:03:17.058005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 123/256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:16 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:17.117359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:17.118423 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:17.126795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:17.127426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:17.127924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:17.128764 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:17.129648 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:17.130219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:17.421706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:17.435801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:17.439113 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:17.444001 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8b07d026-2703-4a67-94f8-b62dea00267e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.331023 Aug 31 07:03:17.447018 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 134/257] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:17 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:18.024270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:18.025036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:18.036182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:18.041033 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:18.041495 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:18.042269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:18.042717 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:18.052176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:18.084084 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:18.088301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:18.098368 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:18.099265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:18.099901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:18.104057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:18.105134 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:18.105134 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:18.385280 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:18.394736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d89f1dfc-34c5-478a-afa2-0260a0630f46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1278 microversion: 2.1 time: 0.320805 Aug 31 07:03:18.398713 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 135/258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:18 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:18.429488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:18.443052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-49dcefd6-3a7b-400d-b9aa-5ab5488ba6bc tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 0.421242 Aug 31 07:03:18.445799 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 124/259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:18 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:18.470368 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:18.472066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:18.478733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:18.479739 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:18.480166 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:18.481248 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:18.482134 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:18.482732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:18.849817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:18.858195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:18.862103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:18.864453 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-02ad2c87-e001-44b9-a386-1aa813741f75 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.400267 Aug 31 07:03:18.865509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 136/260] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:18 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:19.420151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:19.420818 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:19.434306 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:19.434815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:19.435302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:19.437166 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:19.437632 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:19.438056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:19.464719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:19.467710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:19.498564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:19.503103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:19.506371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:19.511101 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:19.511762 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:19.515691 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:19.590306 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:19.615408 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e0c4b392-8275-42fb-93c0-023201389f09 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1278 microversion: 2.1 time: 0.199102 Aug 31 07:03:19.619997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 125/261] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:19 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:19.890385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:19.899622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:19.915585 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:19.916080 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:19.916943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:19.917216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:19.917671 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:19.918370 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:20.022546 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:20.390123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:20.398600 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ae187aea-4563-4d0d-8edf-ecedb3fef7e3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 0.938420 Aug 31 07:03:20.399439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 137/262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:19 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:20.600457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:20.612325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:20.617618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:20.620684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-87e233c2-35a2-40c9-900c-03e7e0b6d0b3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.735488 Aug 31 07:03:20.626167 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 126/263] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:19 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:20.645918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:20.646740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:20.666978 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:20.667487 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:20.667959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:20.670826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:20.671731 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:20.672166 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:20.679114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:20.794924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:20.808058 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-50dc2112-63c0-431b-bfa2-a40d7f0b341c tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1276 microversion: 2.1 time: 0.167494 Aug 31 07:03:20.810643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 138/264] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:20 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:21.429157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:21.429837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:21.449876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:21.449876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:21.449876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:21.463886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:21.470596 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:21.471130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:21.656848 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:21.657438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:21.670515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:21.671278 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:21.671925 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:21.672855 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:21.673608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:21.676473 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:21.797399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:21.810153 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7b37bbd0-5a3c-412d-8297-084f02774827 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 0.388951 Aug 31 07:03:21.827954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 127/265] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:21 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:21.838070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:21.839576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:21.854633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:21.855743 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:21.857878 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:21.859933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:21.864714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:21.866283 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:22.019115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:22.030887 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-77504d39-53f0-4d6a-96db-694eccf2abf7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1276 microversion: 2.1 time: 0.201963 Aug 31 07:03:22.045440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 128/266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:21 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:22.165508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:22.178509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:22.181196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:22.186629 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-89754abc-018f-45cd-920e-c8926a1e0b3a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.532620 Aug 31 07:03:22.206005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 139/267] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:21 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:22.834083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:22.834687 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:22.843070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:22.849476 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:22.850186 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:22.850716 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:22.853004 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:22.856637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:22.857283 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:22.908269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=8 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:23.052320 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:23.052922 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:23.059500 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:23.060352 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:23.060980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:23.061997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:23.062659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:23.063394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:23.145209 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:23.163833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-87cf4372-5855-4b2d-9e68-f34b0668d5ef tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1276 microversion: 2.1 time: 0.114572 Aug 31 07:03:23.164477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 140/268] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:23 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:23.211689 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:23.213007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:23.223271 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:23.226258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:23.227198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:23.227988 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:23.230705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:23.231183 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:23.495073 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:23.520041 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:23.534457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9dd87830-f97a-4870-903f-3f40f4f5a422 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 0.704422 Aug 31 07:03:23.537397 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:23.539420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 129/269] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:22 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:23.553473 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:23.573305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0ee653dd-4368-4717-a009-69ca9548a904 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.364179 Aug 31 07:03:23.573956 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 141/270] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:23 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:24.203607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:24.208249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:24.217399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:24.218333 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:24.219699 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:24.221181 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:24.221831 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:24.223566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:24.362505 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:24.402481 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ca24f665-a59a-4697-915f-9c207f36e599 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1276 microversion: 2.1 time: 0.218592 Aug 31 07:03:24.408527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 130/271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:24 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:24.565374 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:24.565985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:24.582154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:24.584602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:24.587692 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:24.588661 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:24.589284 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:24.591019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:24.601799 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:24.602935 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:24.618208 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:24.619650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:24.621743 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:24.625190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:24.626785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:24.628385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:25.502678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:25.533952 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:25.545255 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:25.554407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1dbcb1d4-cbed-4d3e-ab3d-9f9fd87ee4b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.957719 Aug 31 07:03:25.555278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 131/272] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:24 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:25.570292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:25.572821 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:25.592473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:25.592970 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:25.593400 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:25.594106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:25.594549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:25.606532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:25.615015 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:25.623600 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ba65985d-e44f-4e38-bca2-1388ac3e45b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1508 microversion: 2.1 time: 1.062253 Aug 31 07:03:25.641930 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 142/273] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:24 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1508 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:26.172328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:26.186711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0a8f3762-a759-4560-b7d6-a0a52fdb5fd1 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.629083 Aug 31 07:03:26.187556 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 132/274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:25 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:26.580848 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:26.581827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:26.608028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:26.608527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:26.614953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:26.616033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:26.617283 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:26.619219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:26.650745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:26.650745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:26.668058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:26.668560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:26.672541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:26.673726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:26.674799 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:26.678710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:27.251861 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:27.266113 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:27.268815 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:27.274390 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c278d129-115c-4bb1-9116-57e3bbbe6c54 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.698817 Aug 31 07:03:27.276244 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 143/275] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:26 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:03:27.291075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:27.294222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:27.315235 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:27.319356 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:27.320193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:27.321240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:27.327355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:27.329347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:27.830160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:27.856560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4d986b1f-14eb-436f-b5bd-68436e4e5b2b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1514 microversion: 2.1 time: 1.200464 Aug 31 07:03:27.864673 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 133/276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:26 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1514 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:28.139321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-40711884-68de-450b-8b77-58c9f0694667 req-41345ae1-35e9-475e-a899-3e8536b3ba5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0025cad0-8546-4427-b5c7-fc85d557bdc6", "tag": "e335eb05-f8e3-4b1d-9a6f-052ca29f440d"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:28.177720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-40711884-68de-450b-8b77-58c9f0694667 req-41345ae1-35e9-475e-a899-3e8536b3ba5a service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:28.182541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-40711884-68de-450b-8b77-58c9f0694667 req-41345ae1-35e9-475e-a899-3e8536b3ba5a service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:28.189425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-40711884-68de-450b-8b77-58c9f0694667 req-41345ae1-35e9-475e-a899-3e8536b3ba5a service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:28.238702 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-40711884-68de-450b-8b77-58c9f0694667 req-41345ae1-35e9-475e-a899-3e8536b3ba5a service nova] Creating event network-changed:e335eb05-f8e3-4b1d-9a6f-052ca29f440d for instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 on hv-cinder-85528 Aug 31 07:03:28.265040 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-40711884-68de-450b-8b77-58c9f0694667 req-41345ae1-35e9-475e-a899-3e8536b3ba5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131557 Aug 31 07:03:28.266368 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 134/277] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:28.303358 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:28.304845 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:28.326375 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:28.327476 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:28.330026 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:28.332611 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:28.334699 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:28.335622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:28.594144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:28.622718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ea908289-3483-444f-b218-93bfe24c879a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 1.336450 Aug 31 07:03:28.623757 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 144/278] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:27 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:28.725387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:28.744585 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:28.753794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:28.757902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1b4094e8-5deb-40ee-a955-bcad10955b6f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.460203 Aug 31 07:03:28.766918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 135/279] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:28 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:29.648445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:29.650042 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:29.658145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:29.663971 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:29.667288 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:29.670836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:29.675262 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:29.676247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:29.935310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:29.953899 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9ecda531-7ebb-4118-8129-292e5f5c8832 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.314029 Aug 31 07:03:29.968400 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 136/280] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:29 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:29.973620 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:29.974492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:29.981568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:29.982343 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:29.983055 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:29.983959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:29.984601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:29.985218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:29.989527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4da12b99-47e4-4282-ba79-2c27be80d80c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Action: 'create', calling method: .version_select at 0x7ff9c0a44c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-370224798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiwGpJ8GzRxgucXzjTGQ5VPGawUoZJsnW8RdoHm0hoqf7zKokcrJuJPWo/MKG8YPuQeVkoSGA+OtXXdM1/riNDwrn6VpcIeYktjfTmJ24Fl10rbyEwMQOj0taR9y/fvvA=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:30.044876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-4da12b99-47e4-4282-ba79-2c27be80d80c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:30.053746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-4da12b99-47e4-4282-ba79-2c27be80d80c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for user dcce3144380d4577b91f3e83304f94dd and project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:30.145824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4da12b99-47e4-4282-ba79-2c27be80d80c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.534523 Aug 31 07:03:30.146482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 145/281] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:03:29 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:30.191277 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b8b8bbad-a2b2-4fcf-9676-58ab28908cb8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'create', calling method: .version_select at 0x7ff9c07e8280>, body: {"keypair": {"name": "tempest-keypair-63051102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzyl3zitP8y0DXItdXWlcgy09X3OxTSfeO1gmbhB62JqRqZGDXuseGxzI7KjQ1MYlIbsUYDjglskIbgWj03IgAQY5ax/kLIIMsZEjdDfQO6Z+CU2Li+uWaEF6evNkSVpA=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:30.219436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-b8b8bbad-a2b2-4fcf-9676-58ab28908cb8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for project a83fcf85c5fc44e396c97573a73f675a. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:30.224195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:30.228690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-b8b8bbad-a2b2-4fcf-9676-58ab28908cb8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for user 8b9c07381f404ec39a06e01ff890da5e and project a83fcf85c5fc44e396c97573a73f675a. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:30.237580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:30.239498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:30.242039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-18d494c5-61e2-46f5-b534-26aaae9b8a0c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.272357 Aug 31 07:03:30.246515 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 137/282] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:29 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:30.277538 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b8b8bbad-a2b2-4fcf-9676-58ab28908cb8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.091974 Aug 31 07:03:30.278867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 146/283] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:03:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:30.977592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:30.978240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:30.986804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:30.987315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:30.987745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:30.988636 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:30.989246 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:30.989814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:31.265926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:31.268239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:31.283815 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:31.283815 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:31.283815 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:31.286384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:31.286820 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:31.287795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:31.638721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:31.666756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:31.669508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:31.676355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3f8b57e3-5a1b-4b56-a538-df9e583aa499 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1746 microversion: 2.20 time: 0.414364 Aug 31 07:03:31.677451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 147/284] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:31 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1746 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:03:32.057439 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:32.068021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6757891f-8171-4d10-90e4-6d33a993611f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 1.094911 Aug 31 07:03:32.085096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 138/285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:30 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:32.705737 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:32.706387 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:32.733240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:32.733891 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:32.734534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:32.735457 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:32.736794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:32.737379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:33.092915 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:33.094313 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:33.108360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:33.110486 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:33.111114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:33.112286 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:33.112993 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:33.113635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:33.392313 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:33.404021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2deb2d89-1ca6-4565-98c6-2bfd9803f08b tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.315686 Aug 31 07:03:33.423508 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 139/286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:33 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:33.781660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:33.794645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:33.800621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:33.802148 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ee0affda-e21b-4e54-a6ed-6ad8924546fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1746 microversion: 2.20 time: 1.101724 Aug 31 07:03:33.802714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 148/287] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:32 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1746 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:34.431522 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:34.432125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:34.447631 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:34.448146 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:34.448579 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:34.449324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:34.449772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:34.450197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:34.470262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-340198907", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e985f39d-9936-4167-895a-43b855ba284c"}], "security_groups": [{"name": "tempest-securitygroup--967470135"}], "key_name": "tempest-keypair-63051102", "user_data": "}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:34.863197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:34.878738 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b86a3aa3-71eb-4259-a8cc-46a8d0ec94cc tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.451505 Aug 31 07:03:34.886243 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 140/288] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:34 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:34.898457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:34.899296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:34.919853 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:34.920646 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:34.921281 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:34.922230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:34.923164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:34.923878 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:35.138251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:35.155082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:35.175721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:35.179584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c6a1347e-cb7f-4639-8b64-5441c613440d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.291882 Aug 31 07:03:35.180965 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 141/289] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:34 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:35.917331 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:35.918608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:35.951838 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:35.953873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:35.955492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:35.956537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:35.959295 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:35.959740 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:36.292754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:36.317299 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e85b28eb-e842-4449-8268-366653e77e46 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.394660 Aug 31 07:03:36.335554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 142/290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:35 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:36.362034 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:36.363073 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:36.376844 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:36.377344 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:36.377784 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:36.378498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:36.378987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:36.379414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:36.673467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:36.680355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=100 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:36.684572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:36.686261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:36.689959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-92437490-0dc1-443a-8f0d-2d1ebda6c347 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.349940 Aug 31 07:03:36.691109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 143/291] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:36 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:37.342537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:37.343219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:37.363437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:37.363933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:37.364371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:37.365130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:37.365593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:37.366622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:37.705594 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:37.724811 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-83628c41-4c7e-4665-88aa-da8dd49f04e2 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.380867 Aug 31 07:03:37.745630 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 144/292] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:37 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:37.753965 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:37.753965 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:37.762911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:37.763914 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:37.764594 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:37.765666 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:37.766343 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:37.791499 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:38.184736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:38.203616 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:38.205346 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:38.206755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3a60b89d-d5a9-4f3d-a881-29ad392c7f94 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.459438 Aug 31 07:03:38.207981 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 145/293] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:37 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:38.213544 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-697d93c4-dd6b-4902-b9e7-c18e921c7b37 req-32e05346-fb83-4b5c-a05d-d29cee4e4fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0025cad0-8546-4427-b5c7-fc85d557bdc6", "name": "network-vif-plugged", "status": "completed", "tag": "e335eb05-f8e3-4b1d-9a6f-052ca29f440d"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:38.230198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-697d93c4-dd6b-4902-b9e7-c18e921c7b37 req-32e05346-fb83-4b5c-a05d-d29cee4e4fc3 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:38.231244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-697d93c4-dd6b-4902-b9e7-c18e921c7b37 req-32e05346-fb83-4b5c-a05d-d29cee4e4fc3 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:38.236386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-697d93c4-dd6b-4902-b9e7-c18e921c7b37 req-32e05346-fb83-4b5c-a05d-d29cee4e4fc3 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:38.292073 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-697d93c4-dd6b-4902-b9e7-c18e921c7b37 req-32e05346-fb83-4b5c-a05d-d29cee4e4fc3 service nova] Creating event network-vif-plugged:e335eb05-f8e3-4b1d-9a6f-052ca29f440d for instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 on hv-cinder-85528 Aug 31 07:03:38.307072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-697d93c4-dd6b-4902-b9e7-c18e921c7b37 req-32e05346-fb83-4b5c-a05d-d29cee4e4fc3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097482 Aug 31 07:03:38.310532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 146/294] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:38.750524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:38.751234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:38.770432 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:38.771315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:38.772677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:38.774316 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:38.775059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:38.775705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:39.015232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:39.025427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-96feb942-8360-47af-903e-4abff8b1280f tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.280726 Aug 31 07:03:39.039555 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 147/295] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:38 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:39.232253 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:39.233615 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:39.242665 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:39.243176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:39.243628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:39.244300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:39.244743 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:39.245163 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:39.526335 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:39.538059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:39.540357 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:39.541836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-268f0000-e341-4060-ac67-c9fcce377990 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.313990 Aug 31 07:03:39.543121 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 148/296] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:39 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:40.052405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:40.053334 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:40.065481 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:40.065977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:40.066413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:40.076173 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:40.076722 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:40.077170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:40.240005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=8 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:40.279622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:40.298177 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-15d697da-7965-423f-a3f5-d13608f5dd55 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1318 microversion: 2.1 time: 0.249739 Aug 31 07:03:40.314398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 149/297] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:40 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:40.335380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-54aefdfe-6fce-4646-b822-f6d50ed7ca3f req-1fb642ec-727b-4204-b6e0-f6aa3b3ce973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511f1298-6885-4659-86c4-2bb83fa7803b", "name": "network-vif-plugged", "status": "completed", "tag": "f1143e84-14e6-46df-9c89-a9a60f4e8a19"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:40.347854 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-54aefdfe-6fce-4646-b822-f6d50ed7ca3f req-1fb642ec-727b-4204-b6e0-f6aa3b3ce973 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:40.348609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-54aefdfe-6fce-4646-b822-f6d50ed7ca3f req-1fb642ec-727b-4204-b6e0-f6aa3b3ce973 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:40.349184 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-54aefdfe-6fce-4646-b822-f6d50ed7ca3f req-1fb642ec-727b-4204-b6e0-f6aa3b3ce973 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:40.394106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-54aefdfe-6fce-4646-b822-f6d50ed7ca3f req-1fb642ec-727b-4204-b6e0-f6aa3b3ce973 service nova] Creating event network-vif-plugged:f1143e84-14e6-46df-9c89-a9a60f4e8a19 for instance 511f1298-6885-4659-86c4-2bb83fa7803b on hv-cinder-85528 Aug 31 07:03:40.404812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-54aefdfe-6fce-4646-b822-f6d50ed7ca3f req-1fb642ec-727b-4204-b6e0-f6aa3b3ce973 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074144 Aug 31 07:03:40.405639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 150/298] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:40.422136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:40.422396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:40.447731 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:40.448218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:40.448656 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:40.449467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:40.449975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:40.450398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:40.504525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9e75f327-43e4-4509-96a8-a188e39cca02 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/ips" status: 200 len: 149 microversion: 2.1 time: 0.097546 Aug 31 07:03:40.531332 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 151/299] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:03:40 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/ips => generated 149 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:40.569631 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:40.570319 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:40.584433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:40.589494 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:40.592508 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:40.593583 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:40.594125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:40.594626 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:40.955354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:40.968729 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:40.971633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:40.973011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-37f70a51-4ba3-4d06-a395-1acf35c6e4de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.407613 Aug 31 07:03:40.974005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 152/300] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:40 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:03:41.327309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:41.328683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:41.342674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:41.343532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:41.345023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:41.345975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:41.346575 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:41.347440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:41.584782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:41.595157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c0737231-10d9-4432-b36e-cbe9251dd5cd tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1507 microversion: 2.1 time: 0.274161 Aug 31 07:03:41.596086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 153/301] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:41 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:42.019103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:42.020174 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:42.032866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:42.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:42.034284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:42.035216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:42.036319 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:42.036902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:42.236662 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:42.245492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:42.251101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:42.251101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-aad813f2-7ff6-4465-9d0a-e2add79144e6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.236374 Aug 31 07:03:42.251101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 154/302] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:42 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:42.384828 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf686852-a414-43d5-9bd9-097d3142d6a9"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:42.389077 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:42.397967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:42.397967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:42.399367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:42.399367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:42.399981 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:42.399981 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:42.833846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ca6d5373-0a70-4868-aecd-eb64513bace1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453084 Aug 31 07:03:42.834489 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 155/303] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:03:42 2022] POST /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:03:43.129752 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8de59b99-9c83-4e6d-aba3-b2b5147f2216 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Action: 'create', calling method: .version_select at 0x7ff9c0860f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1649367427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCvLIER5sgST4++8u5HM3CrUCYVGTQLz1JigFQnZaHg3OvXop4ku62z8I2fjAnWrYabB8zBLlTrKX8/tNlrfNW5j2OKFm/C/fN3FpBr3THsMn0q9uPh06Yyd7SzBmqXnQ=="}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:43.136355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:43.150755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-8de59b99-9c83-4e6d-aba3-b2b5147f2216 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Getting quotas for project 9fa1ad38094045b48ce0dc1bb8fa6565. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:43.159893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-8de59b99-9c83-4e6d-aba3-b2b5147f2216 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Getting quotas for user 8222a476868e49a1a0676ead2841030f and project 9fa1ad38094045b48ce0dc1bb8fa6565. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:43.209697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.network.neutron [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] validate_networks() for [('e985f39d-9936-4167-895a-43b855ba284c', None, None, None, None, None)] {{(pid=120770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:03:43.240335 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8de59b99-9c83-4e6d-aba3-b2b5147f2216 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.115440 Aug 31 07:03:43.241599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 156/304] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:03:43 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:03:43.275617 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:43.276587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:43.287143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:43.287923 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:43.288868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:43.289573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:43.290018 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:43.290442 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:43.487600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:43.497148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:43.498882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:43.500233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bb39fb53-2f16-4488-8ee5-db5765f6587e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.231143 Aug 31 07:03:43.501289 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 157/305] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:43 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:43.506074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1692864883", "imageRef": "07148ad3-0439-46c9-a38a-c66816f4dddd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1649367427", "networks": [{"uuid": "bee4b75e-c8ca-4c91-ba00-03fc88257e83"}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:43.537254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:43.789096 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=52 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:43.816019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Flavor limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:03:43.816643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Image limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:03:43.817344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Flavor pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:03:43.817749 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Image pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:03:43.818315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:03:43.829332 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:43.829817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:43.830250 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:43.831029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:43.831479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:43.831896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:43.861157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for project a83fcf85c5fc44e396c97573a73f675a. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:43.865363 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Getting quotas for user 8b9c07381f404ec39a06e01ff890da5e and project a83fcf85c5fc44e396c97573a73f675a. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:43.878481 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Going to run 1 instances... {{(pid=120770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:03:43.881281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:03:43.940962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8563d174-97a4-4ed2-82ce-8cc0b1f30f52 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.476773 Aug 31 07:03:43.941608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 149/306] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:03:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 9478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:03:43.959417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-434559cb-6139-431c-9d70-8908c36dcb27 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:43.960216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-434559cb-6139-431c-9d70-8908c36dcb27 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:44.050896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-434559cb-6139-431c-9d70-8908c36dcb27 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:44.063303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-434559cb-6139-431c-9d70-8908c36dcb27 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1243 microversion: 2.1 time: 0.108608 Aug 31 07:03:44.064408 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 150/307] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:43 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1243 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:44.531529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:44.532934 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:44.540567 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:44.541086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:44.541691 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:44.542611 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:44.543608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:44.544446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:44.709960 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:44.723776 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:44.725509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:44.727132 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c5b69404-bc6e-4da2-8c85-b63a0d1a5320 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.201580 Aug 31 07:03:44.728194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 151/308] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:44 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:45.083928 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:45.084812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:45.092049 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:45.092623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:45.095470 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:45.096432 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:45.097061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:45.097497 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:45.187069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:45.200875 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ee035eff-5d2f-4a32-af87-4e00beab11b4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1295 microversion: 2.1 time: 0.120733 Aug 31 07:03:45.201627 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 152/309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:45 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:45.752507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:45.753214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:45.765135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:45.765736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:45.766216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:45.767020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:45.768567 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:45.769035 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:46.269212 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:46.309372 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:46.312156 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:46.314189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0ea74171-2e1c-47ae-87fb-1728da4d41e4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.565469 Aug 31 07:03:46.316983 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 153/310] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:45 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:03:46.322118 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:46.322705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:46.342529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:46.343061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:46.343709 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:46.344477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:46.344934 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:46.345362 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:46.433543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:46.444131 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1348fa1c-46d4-4b04-ba91-57542b382e33 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1301 microversion: 2.1 time: 0.125782 Aug 31 07:03:46.444997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 154/311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:46 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:47.342545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:47.343678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:47.351086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:47.351763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:47.352486 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:47.353355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:47.353950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:47.354638 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:47.486264 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] validate_networks() for [('bee4b75e-c8ca-4c91-ba00-03fc88257e83', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:03:47.520264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:47.529752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:47.531349 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:47.532768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7da549fa-72a2-49d3-b246-500c855f6e11 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1741 microversion: 2.20 time: 0.195206 Aug 31 07:03:47.533501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 155/312] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:47 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:47.538776 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-742ce79a-972c-4102-9a42-57773efe2395 req-5a096954-4b79-42b1-bfba-26e6e9f04086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8ac19a-b609-4d5a-93ce-78a6abc0ee1d", "tag": "bd463e45-bc79-4baa-970d-739b70ba4761"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:47.551489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-742ce79a-972c-4102-9a42-57773efe2395 req-5a096954-4b79-42b1-bfba-26e6e9f04086 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:47.554328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-742ce79a-972c-4102-9a42-57773efe2395 req-5a096954-4b79-42b1-bfba-26e6e9f04086 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:47.554819 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-742ce79a-972c-4102-9a42-57773efe2395 req-5a096954-4b79-42b1-bfba-26e6e9f04086 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:47.567019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-742ce79a-972c-4102-9a42-57773efe2395 req-5a096954-4b79-42b1-bfba-26e6e9f04086 service nova] Creating event network-changed:bd463e45-bc79-4baa-970d-739b70ba4761 for instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d on hv-cinder-85528 Aug 31 07:03:47.572116 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-742ce79a-972c-4102-9a42-57773efe2395 req-5a096954-4b79-42b1-bfba-26e6e9f04086 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037253 Aug 31 07:03:47.572605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 156/313] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:47.577898 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:47.578584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:47.584659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:47.585124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:47.585553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:47.586225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:47.586829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:47.587270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:47.756353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:47.765642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d7dbf69f-643b-4652-a15c-354649691eaa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.191689 Aug 31 07:03:47.767694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 157/314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:47 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:48.002968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:03:48.003386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:03:48.003847 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:03:48.004271 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:03:48.004682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:03:48.014145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:48.014621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:48.015095 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:48.015817 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:48.016260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:48.016660 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:48.034399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Getting quotas for project 9fa1ad38094045b48ce0dc1bb8fa6565. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:48.039252 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Getting quotas for user 8222a476868e49a1a0676ead2841030f and project 9fa1ad38094045b48ce0dc1bb8fa6565. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:48.051601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:03:48.053848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07148ad3-0439-46c9-a38a-c66816f4dddd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:03:48.112103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1a416e63-c4e4-4518-9623-029ed11ecb1a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.609298 Aug 31 07:03:48.113572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 158/315] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:03:48.126039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7d44875c-9542-4d04-a866-492528d7c120 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:48.126933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7d44875c-9542-4d04-a866-492528d7c120 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:48.182204 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7d44875c-9542-4d04-a866-492528d7c120 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:48.193199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7d44875c-9542-4d04-a866-492528d7c120 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1259 microversion: 2.1 time: 0.072363 Aug 31 07:03:48.194063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 158/316] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:48 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:48.558763 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:48.560213 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:48.568129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:48.568617 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:48.569311 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:48.570085 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:48.570540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:48.571013 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:48.714220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:48.724002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:48.725452 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:48.726605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a99ebb1c-39d2-4036-8e1d-24147548b6fd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1723 microversion: 2.20 time: 0.172029 Aug 31 07:03:48.727205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 159/317] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:48 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:48.787987 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:48.788885 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:48.795804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:48.796294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:48.796725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:48.797568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:48.797914 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:48.798316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:48.943068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:48.951138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c57686a9-fdec-4577-8aa6-e04cc6e739e8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.167218 Aug 31 07:03:48.951690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 159/318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:48 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:49.214357 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:49.215223 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:49.222246 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:49.222733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:49.223233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:49.224004 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:49.224640 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:49.225123 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:49.288675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:49.299661 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f82c31d4-c55b-429e-9a5c-56e7628b57d7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1263 microversion: 2.1 time: 0.089229 Aug 31 07:03:49.300436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 160/319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:49 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:49.751581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:49.752214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:49.758497 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:49.759016 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:49.759419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:49.760132 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:49.760566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:49.761160 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:49.901011 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:49.909559 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:49.911050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:49.912253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f6f8b6ad-ec9e-427e-bdbe-eb2688ce7820 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1723 microversion: 2.20 time: 0.164665 Aug 31 07:03:49.912788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 160/320] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:49 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:49.972381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:49.972996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:49.979511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:49.979996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:49.980443 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:49.981267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:49.981896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:49.982322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:50.117458 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:50.126004 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-60cf64c1-7ffb-472b-8e4a-89b9399db5f5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.157580 Aug 31 07:03:50.134434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 161/321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:49 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:50.323849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:50.324549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:50.330753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:50.331272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:50.331714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:50.332405 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:50.332866 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:50.333288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:50.395546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:50.403507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b985bd17-9df9-4f12-a42f-5e1cdf2d7256 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1255 microversion: 2.1 time: 0.083652 Aug 31 07:03:50.404112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 161/322] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:50 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1255 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:50.936425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:50.936425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:50.952704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:50.953232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:50.953684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:50.954376 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:50.954937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:50.955379 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:50.985549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:51.146578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:51.147886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:51.154903 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:51.155422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:51.155854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:51.156554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:51.156999 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:51.157421 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:51.189401 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:51.198143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:51.199969 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:51.201165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-481325fa-a241-4083-be8a-ddeb6c44f304 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1723 microversion: 2.20 time: 0.270056 Aug 31 07:03:51.201896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 162/323] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:50 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:51.294959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:51.304534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d97a98b5-b69f-45dc-afe2-fe42503561e7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.161923 Aug 31 07:03:51.305407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 162/324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:51 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:51.426488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:51.427371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:51.436125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:51.437158 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:51.437531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:51.449366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:51.452850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:51.453576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:51.621652 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:51.625777 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-887308b1-7288-4169-91ee-2ce496f7fc70 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: .version_select at 0x7ff9c07b6700>, body: {"keypair": {"name": "tempest-keypair-523078035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEewYV+1nl/7bzA42jI9ZkUQKPpARFqz9tNoTCDMKap2oCuyPMaAB5BpX75I0X8++OdMu8KIVZNNXD1vkEUgu3uNGqSXo0ZqAV3y0+Y+jsO9YAKmtw6zj+jTmoneuxJQQ=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:51.638926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dfadaf37-05cb-49a5-bb8c-7222589a5411 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1319 microversion: 2.1 time: 0.217558 Aug 31 07:03:51.640153 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 163/325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:51 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:51.658431 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-887308b1-7288-4169-91ee-2ce496f7fc70 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:51.664552 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-887308b1-7288-4169-91ee-2ce496f7fc70 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:51.704660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-887308b1-7288-4169-91ee-2ce496f7fc70 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090239 Aug 31 07:03:51.706151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 163/326] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:03:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:51.745774 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-fd399b2f-f5b0-4702-b830-105aa2f14a25 req-4c09859f-5ccf-4c43-904c-dd96995ab29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511f1298-6885-4659-86c4-2bb83fa7803b", "name": "network-vif-unplugged", "status": "completed", "tag": "f1143e84-14e6-46df-9c89-a9a60f4e8a19"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:51.766106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fd399b2f-f5b0-4702-b830-105aa2f14a25 req-4c09859f-5ccf-4c43-904c-dd96995ab29b service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:51.766971 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fd399b2f-f5b0-4702-b830-105aa2f14a25 req-4c09859f-5ccf-4c43-904c-dd96995ab29b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:51.767576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fd399b2f-f5b0-4702-b830-105aa2f14a25 req-4c09859f-5ccf-4c43-904c-dd96995ab29b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:51.784105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-fd399b2f-f5b0-4702-b830-105aa2f14a25 req-4c09859f-5ccf-4c43-904c-dd96995ab29b service nova] Creating event network-vif-unplugged:f1143e84-14e6-46df-9c89-a9a60f4e8a19 for instance 511f1298-6885-4659-86c4-2bb83fa7803b on hv-cinder-85528 Aug 31 07:03:51.790114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-fd399b2f-f5b0-4702-b830-105aa2f14a25 req-4c09859f-5ccf-4c43-904c-dd96995ab29b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048679 Aug 31 07:03:51.791126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 164/327] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:03:52.225050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:52.225705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:52.232382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:52.232870 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:52.233310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:52.234006 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:52.234456 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:52.234893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:52.338642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:52.339389 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:52.351809 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:52.353268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:52.354462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:52.357057 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:52.357728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:52.358309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:52.386663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:52.399060 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:52.401129 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:52.402715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-01fe7c87-e9f8-492a-829a-c2d44cc16428 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1723 microversion: 2.20 time: 0.181913 Aug 31 07:03:52.403981 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 164/328] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:52 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:52.601243 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:52.609832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-02843591-b8a9-446f-b3ed-12f33a2cc440 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.288267 Aug 31 07:03:52.610473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 165/329] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:52 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:52.661732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:52.662341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:52.668868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:52.669358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:52.669787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:52.670478 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:52.670962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:52.671383 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:52.735577 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:52.746240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7d2c9f78-f577-4a25-9b16-1c78820605f9 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1317 microversion: 2.1 time: 0.088415 Aug 31 07:03:52.759199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 165/330] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:52 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1317 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:53.313944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1074529355", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d"}], "security_groups": [{"name": "tempest-securitygroup--2000904824"}], "key_name": "tempest-keypair-523078035", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:53.431311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:53.435144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:53.441549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:53.442189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:53.442453 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:53.443279 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:53.443727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:53.444140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:53.596904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:53.606531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:53.608322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:53.609921 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-853d565d-2f91-4bfb-8d90-3d6602fec102 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1723 microversion: 2.20 time: 0.182935 Aug 31 07:03:53.610686 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 166/331] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:53 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:53.638713 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:53.639558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:53.648887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:53.649513 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:53.650553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:53.651410 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:53.651976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:53.653061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:53.811845 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:53.821139 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0270f2b9-bd5a-425e-ab63-ff4384c0c579 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.192089 Aug 31 07:03:53.821716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 167/332] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:53 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:53.827348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:53.827947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:53.839757 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:53.842270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:53.842914 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:53.843481 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:53.844303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:53.844857 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:53.845459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:53.922055 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:53.933550 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-043a98fb-e799-40e0-a14c-8e8fc92a3630 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1317 microversion: 2.1 time: 0.109969 Aug 31 07:03:53.934116 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 168/333] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:53 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1317 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:53.944608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-88dcea69-965d-4495-bccb-1bff55a3b002 req-c638d47c-805b-4d75-ad81-f8e72e7fa397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8ac19a-b609-4d5a-93ce-78a6abc0ee1d", "name": "network-vif-plugged", "status": "completed", "tag": "bd463e45-bc79-4baa-970d-739b70ba4761"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:53.956526 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-88dcea69-965d-4495-bccb-1bff55a3b002 req-c638d47c-805b-4d75-ad81-f8e72e7fa397 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:53.957019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-88dcea69-965d-4495-bccb-1bff55a3b002 req-c638d47c-805b-4d75-ad81-f8e72e7fa397 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:53.957451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-88dcea69-965d-4495-bccb-1bff55a3b002 req-c638d47c-805b-4d75-ad81-f8e72e7fa397 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:53.973238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-88dcea69-965d-4495-bccb-1bff55a3b002 req-c638d47c-805b-4d75-ad81-f8e72e7fa397 service nova] Creating event network-vif-plugged:bd463e45-bc79-4baa-970d-739b70ba4761 for instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d on hv-cinder-85528 Aug 31 07:03:53.978566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-88dcea69-965d-4495-bccb-1bff55a3b002 req-c638d47c-805b-4d75-ad81-f8e72e7fa397 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043261 Aug 31 07:03:53.979219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 169/334] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:54.637967 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:54.638700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:54.645704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:54.646175 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:54.646628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:54.647393 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:54.647848 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:54.648383 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:54.671583 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:54.794958 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:54.803695 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:54.805129 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:54.806435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-13bb0ed3-473d-47cf-96b2-6108307a7807 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1666 microversion: 2.20 time: 0.173522 Aug 31 07:03:54.807041 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 170/335] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:54 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:54.832219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f90258c-432f-4688-a1eb-f42c7ce6af60"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:54.834650 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:54.840855 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:54.841344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:54.841770 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:54.842466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:54.842907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:54.843320 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.169723 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-56f794a5-8fb7-4d4f-97bb-eaba6c00597a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343347 Aug 31 07:03:55.170563 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 171/336] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Aug 31 07:03:54 2022] POST /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:03:55.170563 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:55.176406 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:55.185173 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.186357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.186920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.187760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.188353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.189009 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.345308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:55.354195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ca38ecc3-c855-47c5-a7c4-851bca0178ff tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.182594 Aug 31 07:03:55.354753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 172/337] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:55 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:55.359935 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:55.360524 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:55.367433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.368000 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.368549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.369408 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.369866 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.370358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.522294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:55.530541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5264c339-282d-4c16-b723-131bc601e2b2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.174806 Aug 31 07:03:55.531128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 173/338] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:55 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:55.535450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-7e546178-d831-47a3-b249-a360dd9d274e req-0bb3df69-b187-4cd8-9fad-7104b4872c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55", "tag": "585a62c3-8f91-41fd-81cc-fa2d04d1cc78"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:55.545522 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-7e546178-d831-47a3-b249-a360dd9d274e req-0bb3df69-b187-4cd8-9fad-7104b4872c9b service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.546015 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-7e546178-d831-47a3-b249-a360dd9d274e req-0bb3df69-b187-4cd8-9fad-7104b4872c9b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.546436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-7e546178-d831-47a3-b249-a360dd9d274e req-0bb3df69-b187-4cd8-9fad-7104b4872c9b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.558148 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-7e546178-d831-47a3-b249-a360dd9d274e req-0bb3df69-b187-4cd8-9fad-7104b4872c9b service nova] Creating event network-changed:585a62c3-8f91-41fd-81cc-fa2d04d1cc78 for instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 on hv-cinder-85528 Aug 31 07:03:55.568403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-7e546178-d831-47a3-b249-a360dd9d274e req-0bb3df69-b187-4cd8-9fad-7104b4872c9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035503 Aug 31 07:03:55.570952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 174/339] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:55.576680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:55.577419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:55.583882 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.584458 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.584884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.585577 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.586051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.586440 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.632406 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120770) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 07:03:55.705422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-309015ff-0dca-4113-a9cd-2e3a837bd1c8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/action" status: 202 len: 0 microversion: 2.20 time: 0.133084 Aug 31 07:03:55.709204 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 175/340] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 07:03:55 2022] POST /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:03:55.714218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:55.715003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:55.722675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.723302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.723847 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.724650 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:55.725208 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:55.726044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:55.874030 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:55.883167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:55.884683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:55.886330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-361bb0d8-9c65-4b8d-9aa5-02488df6b025 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.176026 Aug 31 07:03:55.887961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 176/341] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:55 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:03:56.375839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:56.376497 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:56.382918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:56.383621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:56.384053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:56.384750 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:56.385193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:56.385609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:56.414261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] validate_networks() for [('fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:03:56.534228 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:56.543108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-deb9e86b-8b7a-4cb0-b225-9cb2ad57aa00 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1368 microversion: 2.1 time: 0.171388 Aug 31 07:03:56.543794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 177/342] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:56 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:56.553584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:56.554558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:56.561586 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:56.562147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:56.563059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:56.564174 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:56.564334 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:56.564966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:56.757379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:56.767074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-27c83873-ba94-4ee6-9e72-c995d4287516 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.218392 Aug 31 07:03:56.767826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 178/343] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:56 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:56.911505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:56.912402 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:56.925811 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:56.928405 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:56.929721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:56.931605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:56.932069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:56.932494 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:57.272288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:57.282201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:57.295322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:57.296640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-aaa96f82-fc13-4728-a58d-5b1a056abd28 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.390413 Aug 31 07:03:57.312821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 179/344] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:56 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:03:57.567500 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:57.571145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:57.579882 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:57.582985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:57.584141 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:57.585824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:57.586296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:57.586737 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:57.587476 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:03:57.587953 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:03:57.588361 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:03:57.589247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:03:57.589933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:03:57.604386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:57.609047 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:57.609604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:57.610419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:57.610908 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:57.611345 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:57.652895 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:03:57.679435 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:03:57.694185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:03:57.697770 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:03:57.779984 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ab84cab5-d00e-456f-9adb-2387374f1366 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.471855 Aug 31 07:03:57.786336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 166/345] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:03:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 4473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:03:57.790783 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:57.791463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:57.798423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:57.798959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:57.799629 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:57.800534 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:57.800980 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:57.801398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:57.863064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:57.876573 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-991b61ba-3166-4c59-9dd9-3f821d7c1145 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1562 microversion: 2.1 time: 0.313309 Aug 31 07:03:57.877724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 180/346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:57 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1562 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:57.882733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9728a8d6-3791-4458-8aa5-dcdbcc65b770 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:57.883523 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-9728a8d6-3791-4458-8aa5-dcdbcc65b770 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:57.915282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:03:58.003074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-9728a8d6-3791-4458-8aa5-dcdbcc65b770 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:58.010564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-9728a8d6-3791-4458-8aa5-dcdbcc65b770 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1241 microversion: 2.1 time: 0.131500 Aug 31 07:03:58.011259 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 181/347] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:57 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:58.017697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:58.018420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:58.025128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:58.025955 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:58.026610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:58.027598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:58.028314 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:58.029020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:58.053516 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:58.063116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6d9dc42f-9d0c-43cf-95ac-db8e72664acc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.276739 Aug 31 07:03:58.071468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 167/348] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:57 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:58.170975 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b3dc53f1-b842-45a4-99c2-f770b4fc894f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158277 Aug 31 07:03:58.171568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 182/349] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:03:58 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:58.329781 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:58.330413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:58.348169 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:58.348696 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:58.349260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:58.350418 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:58.353943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:58.354521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:58.844592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:58.855711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:58.858168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:58.860522 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9d32e0b9-979e-48c8-9dac-9f900a6d154f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.540600 Aug 31 07:03:58.869795 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 168/350] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:58 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:03:59.042260 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:59.043376 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:59.051739 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:59.052438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:59.053041 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:59.053843 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:59.054359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:59.054858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:59.084856 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:59.085863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:59.097242 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:59.098974 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:59.099490 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:59.104693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:59.108340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:59.109187 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:59.131164 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:59.148222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d76947ca-2b8f-4364-9831-e2033e2397cd tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.111460 Aug 31 07:03:59.149547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 183/351] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:59 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:03:59.412765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:03:59.421253 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a941a125-b2f5-44bb-9b5b-4f1a52cd1675 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.340786 Aug 31 07:03:59.422824 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 169/352] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:03:59 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:03:59.728811 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-2a7fdf18-1bf3-40a7-90ee-78f8e2727abc req-d5fa5176-68dd-40a2-ba84-e80ffd3f00f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8ac19a-b609-4d5a-93ce-78a6abc0ee1d", "tag": "bd463e45-bc79-4baa-970d-739b70ba4761"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:03:59.740196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2a7fdf18-1bf3-40a7-90ee-78f8e2727abc req-d5fa5176-68dd-40a2-ba84-e80ffd3f00f3 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:59.740989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2a7fdf18-1bf3-40a7-90ee-78f8e2727abc req-d5fa5176-68dd-40a2-ba84-e80ffd3f00f3 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:59.741703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2a7fdf18-1bf3-40a7-90ee-78f8e2727abc req-d5fa5176-68dd-40a2-ba84-e80ffd3f00f3 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:59.755467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-2a7fdf18-1bf3-40a7-90ee-78f8e2727abc req-d5fa5176-68dd-40a2-ba84-e80ffd3f00f3 service nova] Creating event network-changed:bd463e45-bc79-4baa-970d-739b70ba4761 for instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d on hv-cinder-85528 Aug 31 07:03:59.761557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-2a7fdf18-1bf3-40a7-90ee-78f8e2727abc req-d5fa5176-68dd-40a2-ba84-e80ffd3f00f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036955 Aug 31 07:03:59.762427 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 184/353] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:03:59.900167 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:03:59.900167 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:03:59.909308 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:59.909863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:59.910291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:03:59.911040 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:03:59.911545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:03:59.912170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:00.084588 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:00.101951 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:00.103667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:00.105135 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a1ca1c8c-1a73-4a16-a408-05307769703d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.219227 Aug 31 07:04:00.111430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 170/354] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:03:59 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:00.174412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:00.175801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:00.186904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:00.188486 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:00.189166 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:00.190114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:00.191358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:00.191996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:00.275480 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:00.284102 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7521773c-f618-4601-89c9-3c59a2412ed8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.114041 Aug 31 07:04:00.306142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 185/355] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:00 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:00.443409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:00.444329 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:00.451829 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:00.452596 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:00.453357 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:00.454220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:00.454837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:00.455433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:00.619022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:00.628046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-917c5c16-ad71-471e-81e3-9c44f3b01a3e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.188890 Aug 31 07:04:00.640890 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 171/356] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:00 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:01.129513 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:01.130154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:01.136873 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:01.137457 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:01.138252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:01.139057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:01.139578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:01.140215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:01.145459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:01.284534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:01.294522 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:01.296404 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:01.300677 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-76f1b681-6062-45a7-9295-08649a4b6a44 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.175146 Aug 31 07:04:01.305688 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 186/357] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:01 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:01.321634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:01.322298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:01.328852 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:01.329327 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:01.329756 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:01.330440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:01.330926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:01.331382 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:01.401541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:01.411554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c24a05f9-b961-4c85-bc2b-eeeda815879f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.093570 Aug 31 07:04:01.412642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 172/358] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:01 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:01.648662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:01.649213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:01.656481 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:01.657242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:01.657797 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:01.658506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:01.659021 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:01.659447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:01.818316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:01.827862 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8394f1d7-194a-4db0-b33c-03502855e8fd tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.182991 Aug 31 07:04:01.828442 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 187/359] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:01 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:02.324306 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:02.325036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:02.331896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:02.332374 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:02.332799 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:02.333488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:02.333928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:02.334346 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:02.434087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:02.434960 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:02.442795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:02.443427 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:02.444036 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:02.444811 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:02.445330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:02.445817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:02.496964 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:02.505978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:02.507768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:02.508608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-95c25d3f-2886-4d4f-b24f-e4b7a63e1c61 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.188290 Aug 31 07:04:02.509205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 173/360] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:02 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:02.509992 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:02.518117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-70aad3cc-2efe-41c4-b912-580fd54ae304 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.088075 Aug 31 07:04:02.518880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 188/361] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:02 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:02.849764 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:02.850584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:02.857765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:02.858201 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:02.858624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:02.859360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:02.859807 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:02.860419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:03.014326 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:03.023207 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-83a4dc19-ef35-43f3-be8d-d8ce914b0a4e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.177255 Aug 31 07:04:03.023974 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 174/362] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:02 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:03.532154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:03.532814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:03.539061 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:03.539671 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:03.540500 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:03.541048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:03.541479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:03.542138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:03.542581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:03.543032 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:03.547155 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:03.547692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:03.548129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:03.549012 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:03.549665 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:03.550148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:03.640877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:03.648768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5f7fe538-5cd1-4277-9cde-93f2320c3f36 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.113897 Aug 31 07:04:03.649564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 175/363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:03 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:03.700387 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:03.709963 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:03.711518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:03.712716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-84695215-c7fc-4ffb-b2e5-628ed19ab7b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.184646 Aug 31 07:04:03.713427 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 189/364] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:03 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:04.046947 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:04.047780 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:04.055587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:04.056235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:04.056771 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:04.057789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:04.058339 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:04.059081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:04.194570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:04.206692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1a2b4aca-ade4-4224-85b6-eed8b031154d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.164299 Aug 31 07:04:04.207380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 176/365] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:04 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:04.674535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:04.675452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:04.685351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:04.685999 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:04.686439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:04.687170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:04.687625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:04.688228 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:04.737570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:04.738409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:04.750816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:04.750816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:04.750816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:04.750816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:04.752575 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:04.752575 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:04.777862 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:04.796660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e4c7acb5-bd97-499e-a007-3ed70a219637 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.128580 Aug 31 07:04:04.797554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 190/366] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:04 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:04.891268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:04.900463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:04.901869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:04.903063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-42fe671e-e3b3-4b6c-b14b-5c975b5ffcd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.170669 Aug 31 07:04:04.904234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 177/367] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:04 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:05.227945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:05.228560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:05.235711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:05.235711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:05.236132 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:05.236865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:05.237324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:05.237760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:05.376191 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:05.384127 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5a885f5d-ae37-4799-b638-ef7948bfee0c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.160226 Aug 31 07:04:05.384966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 191/368] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:05 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:05.817628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:05.818281 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:05.824779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:05.825256 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:05.825890 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:05.826703 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:05.827179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:05.827599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:05.899933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:05.908854 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cda036f2-3c74-4b02-9729-48f3eb3093e4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.095067 Aug 31 07:04:05.924218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 178/369] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:05 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:05.928880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:05.929576 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:05.936644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:05.937396 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:05.937830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:05.938543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:05.939241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:05.939842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:06.086489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:06.095617 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:06.097056 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:06.098488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1900b562-f568-440d-b649-f8b60f8af9fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.173775 Aug 31 07:04:06.099194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 192/370] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:05 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:04:06.405276 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:06.405897 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:06.412717 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:06.413196 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:06.413990 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:06.414674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:06.415156 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:06.415572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:06.554266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:06.562097 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-336223e6-0aaa-4ecf-a4c3-03713f87408c tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.160793 Aug 31 07:04:06.562660 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 179/371] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:06 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:06.933064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:06.933881 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:06.942181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:06.942837 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:06.943461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:06.944387 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:06.944991 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:06.945571 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:07.014915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:07.022921 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5dc6c56a-7a90-4034-9c03-5ea7087a55b9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1245 microversion: 2.1 time: 0.094823 Aug 31 07:04:07.023305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 193/372] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:06 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:07.124658 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:07.125231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:07.132326 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:07.132813 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:07.133247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:07.133949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:07.134405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:07.134834 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:07.150698 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=100 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:07.270043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:07.279545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:07.281278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:07.282206 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ed6c4ce5-3e44-477f-a16e-d80aa7be4a88 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1752 microversion: 2.20 time: 0.163259 Aug 31 07:04:07.282761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 180/373] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:07 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:07.583520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:07.584058 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:07.590475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:07.590991 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:07.591423 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:07.592109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:07.592541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:07.592961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:07.736462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:07.745924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5173c62e-49ca-4008-997b-cb0b167f6e69 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.166348 Aug 31 07:04:07.746504 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 194/374] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:07 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:08.047743 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:08.048676 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:08.051469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=4 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:08.052451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=16 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:08.061132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:08.061605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:08.062034 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:08.062723 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:08.063200 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:08.063613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:08.126487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:08.135087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bae86986-b3b5-45e6-9dfc-e47ac72e338a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1293 microversion: 2.1 time: 0.093256 Aug 31 07:04:08.135655 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 181/375] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:08 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:08.309173 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:08.310143 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:08.313230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=16 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:08.322371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:08.323240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:08.323947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:08.325123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:08.325861 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:08.326604 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:08.464803 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:08.473771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:08.475220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:08.476362 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b5aa2f2b-6fe3-4c84-80c9-76c939194f08 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1754 microversion: 2.20 time: 0.173747 Aug 31 07:04:08.476915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 195/376] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:08 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:08.772147 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:08.773161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:08.782148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:08.782636 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:08.783106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:08.783802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:08.784252 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:08.784673 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:08.933888 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:08.943444 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a861ddb9-20d5-41a7-831b-c6c7d0cb39bc tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.178026 Aug 31 07:04:08.944220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 182/377] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:08 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:09.157499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:09.157780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:09.167105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:09.170318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:09.171181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:09.172051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:09.172518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:09.177275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:09.247307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:09.256193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-348fb801-02a5-4535-a6d3-c42cc9a87d44 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1293 microversion: 2.1 time: 0.102726 Aug 31 07:04:09.257004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 196/378] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:09 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:09.500148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:09.500910 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:09.507987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:09.508576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:09.509110 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:09.509901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:09.510450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:09.511025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:09.591183 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1645172647", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-370224798", "security_groups": [{"name": "tempest-secgroup-smoke-1092924035"}], "block_device_mapping_v2": [{"uuid": "6e9c8d1b-0a36-45b0-a705-3792e3ca5aaa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66ebf559-4ea4-4b90-866a-bf1d2835263f"}]}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:09.708208 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.network.neutron [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] validate_networks() for [('66ebf559-4ea4-4b90-866a-bf1d2835263f', None, None, None, None, None)] {{(pid=120770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:04:09.708613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:09.718128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:09.719606 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:09.720773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b704aa21-7c79-4be5-9ff3-fac9f0252611 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1754 microversion: 2.20 time: 0.225005 Aug 31 07:04:09.721344 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 183/379] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:09 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:09.970726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:09.971383 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:09.982128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:09.983467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:09.983969 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:09.984746 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:09.985765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:09.986199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:10.185205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Flavor limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:04:10.185603 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Image limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:04:10.186990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Flavor pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:04:10.188041 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Image pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:04:10.188403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:04:10.198741 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:10.199250 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:10.199485 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:10.199854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:10.200869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:10.201471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:10.202273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:10.208684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a4fe2078-dda8-4893-8ef1-1622f15136a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.246252 Aug 31 07:04:10.209269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 184/380] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:09 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:10.230971 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:04:10.235891 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for user dcce3144380d4577b91f3e83304f94dd and project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:04:10.277468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:10.278103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:10.282046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:10.296147 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:10.298000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:10.298468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:10.299244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:10.299694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:10.303719 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:10.340190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Going to run 1 instances... {{(pid=120770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:04:10.342694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e9c8d1b-0a36-45b0-a705-3792e3ca5aaa',volume_size=None,volume_type=None)] {{(pid=120770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:04:10.401854 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:10.410078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9dfae551-00d0-45cb-97d7-703e7e56b551 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1299 microversion: 2.1 time: 0.136341 Aug 31 07:04:10.410650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 185/381] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:10 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1299 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:10.490946 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5439ed51-81c4-4ae9-9958-fe76e3849843 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.903479 Aug 31 07:04:10.492522 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 197/382] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:04:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:04:10.506234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4933c5ce-1a96-40eb-a1ac-e44918078a23 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:10.506839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4933c5ce-1a96-40eb-a1ac-e44918078a23 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:10.745086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:10.746530 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:10.757285 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:10.757966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:10.758579 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:10.760063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:10.760662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:10.761394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:10.834620 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4933c5ce-1a96-40eb-a1ac-e44918078a23 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:10.844171 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4933c5ce-1a96-40eb-a1ac-e44918078a23 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1094 microversion: 2.1 time: 0.343688 Aug 31 07:04:10.845807 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 186/383] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:10 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1094 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:10.924396 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:10.933438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:10.935016 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:10.936304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e11243c9-a767-4781-9533-c244dff5e69b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.196261 Aug 31 07:04:10.937346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 198/384] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:10 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:11.231361 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:11.232421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:11.241368 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.242488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.243044 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.243895 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.244573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.245067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.413368 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d91dcd40-fc93-48c3-b1eb-ea0505324805", "device": "/dev/sdb"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:11.420351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:11.426781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.427302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.427919 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.428851 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.429231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.429710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.563904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:11.579338 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3a7971db-da81-4902-89e7-adc7270c7de5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.346720 Aug 31 07:04:11.581018 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 187/385] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:11 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:11.590700 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:11.591647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:11.609504 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.614456 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.615366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.616374 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.616864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.617451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.833008 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d2cd8b44-c947-4567-8ca8-2a69ad6d8516 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "POST /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423353 Aug 31 07:04:11.834257 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 199/386] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:04:11 2022] POST /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:11.870885 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:11.871818 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:11.884171 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.885761 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.886225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.887267 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.888469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.888907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.916287 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:11.924274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9cf74385-2e46-4027-aa27-c6d3510e75dc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.339385 Aug 31 07:04:11.924854 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 188/387] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:11 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:11.960120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:11.960726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:11.965231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:11.967247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.968340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.969305 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.970205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:11.970831 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:11.971423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:11.973439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5b241836-64d0-4b8a-a194-975eadbc52b9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1192 microversion: 2.1 time: 0.110846 Aug 31 07:04:11.974098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 200/388] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:11 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:12.115147 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:12.124760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:12.126155 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:12.127564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8d5fe574-9c80-4403-97c4-64ed2d1a08d9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.171403 Aug 31 07:04:12.128096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 189/389] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:11 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:04:12.601593 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:12.602277 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:12.609208 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:12.609704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:12.610128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:12.610852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:12.611316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:12.611740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:12.741107 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:12.748982 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6bb6de5a-227f-4290-8f1f-5471d475b21d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.151588 Aug 31 07:04:12.749698 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 201/390] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:12 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:12.946059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:12.947154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:12.965789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:12.965789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:12.965789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:12.965789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:12.966088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:12.966088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:12.994427 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:12.995130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:13.003871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.004449 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.004969 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.006213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.006668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.007189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.013513 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:13.083413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:13.091213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-25f0a111-bb35-4afc-b15a-5d80e711ebb9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1210 microversion: 2.1 time: 0.101069 Aug 31 07:04:13.091862 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 202/391] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:12 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:13.150879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:13.151475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:13.159284 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.159891 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.160334 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.161086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.161530 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.161982 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.319384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:13.322812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:13.328529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:13.329949 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:13.331138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-52a4c977-3747-4c20-8286-508b9e34658b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.184209 Aug 31 07:04:13.331571 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5ebc3355-fa63-4c11-a5c7-5e4d14f30905 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.389698 Aug 31 07:04:13.332014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 203/392] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:13 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:13.340731 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 190/393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:12 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:13.600579 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-89742ef1-916b-4821-b507-89c21b84949b req-571d0e7e-78f7-41ac-941a-65c61abbc1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336cfa5e-6e07-45f0-af84-07847284d723", "tag": "6a3a3984-9c5f-43b0-817c-b3924c1cd829"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:13.639167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-89742ef1-916b-4821-b507-89c21b84949b req-571d0e7e-78f7-41ac-941a-65c61abbc1c4 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.639782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-89742ef1-916b-4821-b507-89c21b84949b req-571d0e7e-78f7-41ac-941a-65c61abbc1c4 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.644824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-89742ef1-916b-4821-b507-89c21b84949b req-571d0e7e-78f7-41ac-941a-65c61abbc1c4 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.668576 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-89742ef1-916b-4821-b507-89c21b84949b req-571d0e7e-78f7-41ac-941a-65c61abbc1c4 service nova] Creating event network-changed:6a3a3984-9c5f-43b0-817c-b3924c1cd829 for instance 336cfa5e-6e07-45f0-af84-07847284d723 on hv-cinder-85528 Aug 31 07:04:13.680996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-89742ef1-916b-4821-b507-89c21b84949b req-571d0e7e-78f7-41ac-941a-65c61abbc1c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094204 Aug 31 07:04:13.684614 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 204/394] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:13.772453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:13.773723 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:13.789163 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.790011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.790725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.794036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.795185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.795904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.879901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-74b83561-3dcc-4a18-87f9-ccead09624b3 req-9b98303e-0ee5-4b59-a37f-a60a9c3652d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55", "name": "network-vif-plugged", "status": "completed", "tag": "585a62c3-8f91-41fd-81cc-fa2d04d1cc78"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:13.906705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-74b83561-3dcc-4a18-87f9-ccead09624b3 req-9b98303e-0ee5-4b59-a37f-a60a9c3652d7 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:13.910769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-74b83561-3dcc-4a18-87f9-ccead09624b3 req-9b98303e-0ee5-4b59-a37f-a60a9c3652d7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:13.911760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-74b83561-3dcc-4a18-87f9-ccead09624b3 req-9b98303e-0ee5-4b59-a37f-a60a9c3652d7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:13.945992 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-74b83561-3dcc-4a18-87f9-ccead09624b3 req-9b98303e-0ee5-4b59-a37f-a60a9c3652d7 service nova] Creating event network-vif-plugged:585a62c3-8f91-41fd-81cc-fa2d04d1cc78 for instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 on hv-cinder-85528 Aug 31 07:04:13.959749 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-74b83561-3dcc-4a18-87f9-ccead09624b3 req-9b98303e-0ee5-4b59-a37f-a60a9c3652d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089405 Aug 31 07:04:13.961624 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 205/395] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:14.112725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:14.113440 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:14.116642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:14.119817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:14.125103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-051fb6e5-36d2-4666-8269-a6b0cd67c51a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.356300 Aug 31 07:04:14.131620 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:14.132290 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:14.133173 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:14.138912 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:14.139126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 191/396] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:13 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:14.139823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:14.298357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:14.306700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-16f8bab1-ef9a-4dcc-977f-e3bc33a547da tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.198133 Aug 31 07:04:14.308643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 206/397] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:14 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:14.355269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:14.357111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:14.361400 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:14.362442 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:14.373142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:14.373720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:14.374782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:14.375005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:14.375497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:14.375607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:14.375932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:14.376043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:14.376377 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:14.376629 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:14.377074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:14.377691 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:14.524251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:14.533295 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:14.534760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:14.535942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-86fe7584-68c3-43e0-9699-fec2f37638bc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.185902 Aug 31 07:04:14.536514 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 192/398] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:14 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:14.543668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:14.552282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8138c480-8f65-492a-8159-8a7b50a29844 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.194932 Aug 31 07:04:14.552786 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 207/399] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:14 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:15.151487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:15.151487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:15.156265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.156753 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.157181 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.157879 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.159043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.159492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.305939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:15.314002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c83dff87-dc61-4cf9-ad77-bc1a9aa2c0c7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.171070 Aug 31 07:04:15.331324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 193/400] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:15 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:15.332936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:15.333531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:15.340382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.340870 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.341299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.342002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.342512 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.343069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.483918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:15.491880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e3126445-e081-408f-a6c5-ce88e1ea1233 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.163653 Aug 31 07:04:15.492446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 208/401] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:15 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:15.559772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:15.560389 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:15.567249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.567987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.568659 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.569525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.575825 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:15.577299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:15.580314 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.580955 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.587038 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.587507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.587943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.588651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:15.589098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:15.589517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:15.726671 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:15.736592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:15.738043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:15.739254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c295fcc9-c22b-48b8-aae2-b6562bc2bcfc tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.183616 Aug 31 07:04:15.740492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 194/402] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:15 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:15.759426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:15.767575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5b36baab-cbdc-49d5-9357-ea36dcea3db5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.196803 Aug 31 07:04:15.768627 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 209/403] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:15 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:16.340692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:16.342036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:16.350727 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.351272 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.351709 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.352620 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.353079 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.353512 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.513672 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:16.514319 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:16.516375 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:16.521335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.521816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.522237 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.523318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.523763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.524178 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.524986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e228d0d8-743e-49fd-893c-a1e554fc485e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.189274 Aug 31 07:04:16.525652 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 195/404] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:16 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:16.659907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:16.668258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-646b9e47-dc7c-4215-9587-e84c42e01740 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.159068 Aug 31 07:04:16.668840 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 210/405] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:16 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:16.765453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:16.766048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:16.774789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.775392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.775926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.776634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.777211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.777693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.795015 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:16.796768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:16.806414 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.806939 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.807443 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.808290 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:16.808737 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:16.809227 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:16.943695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:16.948931 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:16.953273 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:16.954766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:16.955927 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-fcdbbd9f-e3a6-4903-80d8-73c5f3792507 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.195722 Aug 31 07:04:16.956489 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 196/406] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:16 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:16.957451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2ae53e2a-e71f-47f3-b9fa-a35fd1eae32a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.170977 Aug 31 07:04:16.958079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 211/407] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:16 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:17.546510 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:17.547322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:17.554271 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.554866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.555385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.556183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.556689 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.557179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.690702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:17.692555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:17.698324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:17.700085 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.700575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.701008 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.702136 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.702881 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.703723 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.708225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-71a88d00-0ecd-4c09-a3ac-2bb4b2b32aa3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.165892 Aug 31 07:04:17.709405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 197/408] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:17 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:17.849891 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:17.859236 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a4958f2d-5045-4301-8718-0db0f33a8b2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.173591 Aug 31 07:04:17.861025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 212/409] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:17 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:17.979328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:17.979936 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:17.980301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:17.980889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:17.986223 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.986728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.986890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.987165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.987311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.987738 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.987841 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.988288 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.988401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:17.988704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.988841 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:17.989254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:17.991347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=100 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:18.139089 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:18.149351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:18.151089 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:18.152484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-76b88d6d-7a0e-46cd-99cc-0b95b18a11c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.175973 Aug 31 07:04:18.153482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 213/410] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:17 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:04:18.422318 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:18.440968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3aa33148-a6d1-4a26-afa4-8f36a4ffb340 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.465543 Aug 31 07:04:18.444254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 198/411] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:17 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:18.732299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:18.733093 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:18.740397 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:18.740875 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:18.741351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:18.741993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:18.742436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:18.742881 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:18.881520 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:18.882309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:18.888889 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:18.889371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:18.889985 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:18.890830 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:18.891312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:18.892440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:18.894456 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:18.902348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a43ebc5d-e9e6-45a8-9076-e9b38eb8ac92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.175473 Aug 31 07:04:18.902940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 214/412] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:18 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:19.030232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:19.038602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d468d603-06aa-4f3e-ba5d-b4556cefe849 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.161581 Aug 31 07:04:19.052032 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 199/413] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:18 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:19.180117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:19.181091 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:19.192883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:19.192883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:19.192883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:19.192883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:19.193350 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:19.193350 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:19.329507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:19.339206 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:19.340706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:19.341920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-11fc3030-cd29-4f4d-a2ab-0d2add359f13 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.168646 Aug 31 07:04:19.342455 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 215/414] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:19 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:04:19.462123 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:19.462720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:19.469413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:19.469891 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:19.470319 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:19.471040 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:19.471484 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:19.471898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:19.609450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:19.617680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1a32eea3-38f3-423e-991d-d1c833b06128 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.159575 Aug 31 07:04:19.618654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 200/415] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:19 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:19.924012 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:19.924696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:19.931838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:19.932323 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:19.932750 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:19.933436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:19.934112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:19.934753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:20.061019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:20.061771 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:20.068880 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:20.069649 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:20.070268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:20.071178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:20.071814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:20.072414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:20.076809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:20.098193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-82b7eecb-043a-40d1-8e81-8054fdecc5c3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.166577 Aug 31 07:04:20.099183 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 216/416] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:19 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:20.227757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:20.236357 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6314dd15-6ad9-4ce5-9a30-390a35a7ebf6 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.179244 Aug 31 07:04:20.243875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 201/417] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:20 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:20.366282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:20.366899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:20.368948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:20.369972 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=6 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:20.375281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:20.376401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:20.376863 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:20.377526 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:20.377980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:20.378405 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:20.526030 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:20.535560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:20.536994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:20.538171 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2c687b30-b134-400d-b57f-ad5b8859e5e7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.175911 Aug 31 07:04:20.539105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 217/418] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:20 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:20.640990 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:20.641770 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:20.648291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:20.648857 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:20.649374 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:20.650312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:20.650933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:20.651580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:20.796035 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:20.803706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d3e4b105-a236-4bd9-a6ef-5b3e194520de tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.167398 Aug 31 07:04:20.804266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 202/419] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:20 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:21.119242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:21.119904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:21.127124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.127602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.128017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.128693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.129132 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.129546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.265292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:21.266990 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:21.267128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:21.269171 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:21.275893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.276932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.277605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.278537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.279225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.280000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.285216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-379232ef-892f-4497-91b4-15e86e8935c2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.169758 Aug 31 07:04:21.285812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 218/420] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:21 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:21.425999 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:21.434115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a8494ba2-d2f5-4e81-b33d-3adb942c5a2a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.173115 Aug 31 07:04:21.434704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 203/421] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:21 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:21.561717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:21.562584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:21.572048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.572637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.573125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.573886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.574403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.574899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.718317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:21.728222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:21.729801 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:21.731186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6021a81d-6f90-4249-b633-14c46b785f2a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.173434 Aug 31 07:04:21.732059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 219/422] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:21 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:21.826011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:21.826706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:21.833410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.833982 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.834487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.835848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:21.835948 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:21.836387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:21.981000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:21.989065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-21919172-ed94-4a47-a88b-dff46adfa9a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.167136 Aug 31 07:04:21.989663 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 204/423] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:21 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:22.308254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:22.309833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:22.317253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:22.317726 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:22.318156 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:22.318889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:22.319501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:22.320068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:22.324649 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:22.455324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:22.456022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:22.462483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:22.463004 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:22.463436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:22.464139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:22.464551 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:22.464725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:22.465131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:22.473762 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c206409b-6fdb-4c66-b043-2ba882873ac2 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.169934 Aug 31 07:04:22.474581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 220/424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:22 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:22.610103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:22.621809 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-54c8210f-815b-4757-96a0-bdf9149eb0c5 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.170646 Aug 31 07:04:22.622564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 205/425] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:22 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:22.755121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:22.755725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:22.762056 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:22.762565 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:22.763018 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:22.763713 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:22.764147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:22.764560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:22.898230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:22.907065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:22.908494 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:22.909680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4889d241-2027-4abe-9a7e-c21961cdbdd6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.158581 Aug 31 07:04:22.910213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 221/426] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:22 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:23.010714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:23.011341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:23.018222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.018705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.019168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:23.019859 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.020308 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.020737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:23.158188 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:23.167328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d448fa02-06cf-4696-bd2a-2ba42e020076 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.160625 Aug 31 07:04:23.167900 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 206/427] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:23 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:23.495916 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:23.496602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:23.503852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.504430 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.504927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:23.505727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.506195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.506613 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:23.641876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:23.642275 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:23.643103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:23.651994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-243d0af3-6fe7-4f5c-8afc-d211fe317cd1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.159972 Aug 31 07:04:23.652182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.653073 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.653590 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:23.654587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.655462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 222/428] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:23 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:23.655797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.656378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:23.932576 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:23.933332 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:23.936534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:23.940156 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.940641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.941074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:23.941755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:23.943385 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:23.943385 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:24.042387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:24.052629 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d77995dc-cb47-4381-b12b-e054b9a16224 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.414628 Aug 31 07:04:24.066109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 207/429] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:23 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:24.083144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:24.091985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:24.093412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:24.094657 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-dcd5300f-3172-4541-9c38-334f687433d5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.166106 Aug 31 07:04:24.095250 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 223/430] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:23 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:04:24.190180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:24.190790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:24.197240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:24.197726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:24.198152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:24.198869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:24.199324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:24.199742 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:24.309695 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-110316fa-c5bf-439c-b410-349a83a2d01d req-1a9cfc6d-1a22-45ac-a0ea-72edddb9d8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de723bf7-b3b4-4f94-ac57-188c9b729f30", "tag": "9129b959-b9e7-4911-91eb-bce08274bbed"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:24.319646 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-110316fa-c5bf-439c-b410-349a83a2d01d req-1a9cfc6d-1a22-45ac-a0ea-72edddb9d8d2 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:24.320109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-110316fa-c5bf-439c-b410-349a83a2d01d req-1a9cfc6d-1a22-45ac-a0ea-72edddb9d8d2 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:24.320536 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-110316fa-c5bf-439c-b410-349a83a2d01d req-1a9cfc6d-1a22-45ac-a0ea-72edddb9d8d2 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:24.332231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-110316fa-c5bf-439c-b410-349a83a2d01d req-1a9cfc6d-1a22-45ac-a0ea-72edddb9d8d2 service nova] Creating event network-changed:9129b959-b9e7-4911-91eb-bce08274bbed for instance de723bf7-b3b4-4f94-ac57-188c9b729f30 on hv-cinder-85528 Aug 31 07:04:24.337268 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-110316fa-c5bf-439c-b410-349a83a2d01d req-1a9cfc6d-1a22-45ac-a0ea-72edddb9d8d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031212 Aug 31 07:04:24.338092 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 224/431] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:24.391585 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:24.402416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d039a392-c3ce-4e06-a467-b29d95bb4131 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.216436 Aug 31 07:04:24.408917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 208/432] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:24 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:24.677008 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:24.677688 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:24.684183 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:24.684710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:24.685143 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:24.685832 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:24.686311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:24.686675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:24.820642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:24.828622 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-040c9b55-f5d0-4ca3-84dd-70d4e74a2aaf tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.157004 Aug 31 07:04:24.829247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 225/433] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:24 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:25.073845 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:25.074483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:25.081356 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.081841 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.082267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.082990 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.083436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.083850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.117584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:25.118335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:25.125094 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.125703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.126392 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.128072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.128591 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.129124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.215879 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:25.223919 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d5e21651-1831-45d4-9695-8fb018126552 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.153966 Aug 31 07:04:25.224606 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 209/434] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:25 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:25.263253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:25.272010 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:25.273433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:25.274637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c512ce56-0392-4b6a-b9f0-ccb41e8d17b7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.161297 Aug 31 07:04:25.275175 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 226/435] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:25 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:25.426621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:25.427267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:25.433727 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.434207 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.434633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.435349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.435790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.436202 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.566234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:25.574195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e04ed053-3361-4494-bfe6-6a5fe25b8ae3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.152120 Aug 31 07:04:25.574742 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 210/436] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:25 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:25.851492 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:25.852102 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:25.858612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.859204 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.859628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.860334 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:25.860832 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:25.861252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:25.991887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:25.999929 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5002c89a-ff69-42c2-8a98-25cf2e586436 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.152336 Aug 31 07:04:26.000491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 227/437] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:25 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:26.244987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:26.245591 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:26.252540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:26.253268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:26.253883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:26.254583 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:26.255126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:26.255540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:26.297850 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:26.298782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:26.305315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:26.305861 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:26.306295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:26.307125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:26.307509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:26.307933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:26.395143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:26.403871 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-adbed929-c803-454e-a026-6497e5f048ca tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.162700 Aug 31 07:04:26.404444 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 211/438] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:26 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:26.598259 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:26.598995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:26.605441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:26.605925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:26.606356 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:26.607091 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:26.607540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:26.607961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:26.655455 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:26.665136 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:26.666609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:26.667811 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ef241590-108c-4294-abe5-8e1ec90e5657 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.374062 Aug 31 07:04:26.668388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 228/439] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:26 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:04:26.736375 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:26.744189 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4b245f49-7490-4afe-ad8d-7d4f2db65626 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.150688 Aug 31 07:04:26.744756 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 212/440] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:26 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:27.020444 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:27.021033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:27.027800 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.028285 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.028714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.029398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.029849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.030263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.158407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:27.166873 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1cdde0dd-04ee-4c27-9431-a649ef3fa119 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.150453 Aug 31 07:04:27.167444 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 229/441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:27 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:27.429813 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:27.430641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:27.441088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.441570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.441997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.442686 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.443183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.443608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.582281 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:27.594182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-48e85bd0-c95a-4e7a-b20b-318c18312691 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.171030 Aug 31 07:04:27.595386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 213/442] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:27 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:27.696271 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:27.697160 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:27.706886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.707407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.707847 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.708545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.708994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.709421 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.764978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:27.765803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:27.772498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.773051 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.773555 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.774324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:27.774835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:27.775291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:27.849322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:27.859589 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:27.861798 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:27.863761 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6069f1ec-a6c8-4887-833c-fb7089230ae0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.175235 Aug 31 07:04:27.864401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 230/443] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:27 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:27.912007 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:27.914605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=100 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:27.921450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-942dd4fc-ec25-4198-a532-71fb55641e34 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.160385 Aug 31 07:04:27.922006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 214/444] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:27 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:28.187429 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:28.187988 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:28.195040 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.195529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.195986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:28.196646 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.197091 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.197510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:28.329432 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:28.341187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8bd651b3-768a-4975-a5a6-aed6efcd49e1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.157390 Aug 31 07:04:28.341896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 231/445] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:28 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:28.619305 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:28.620306 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:28.631708 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.632510 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.633228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:28.634367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.635185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.635886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:28.776522 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:28.785028 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d1777306-659b-445a-94c8-a1e24280b67f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.172327 Aug 31 07:04:28.785595 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 215/446] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:28 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:28.887403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:28.888035 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:28.894976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.895479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.895936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:28.896645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.897112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.897550 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:28.943669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:28.944268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:28.950385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.950868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.951327 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:28.952012 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:28.952454 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:28.952869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:29.032345 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:29.041826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:29.043288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:29.044455 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-30d2afd5-0fcb-4a18-a483-ec6e32e028b4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.161246 Aug 31 07:04:29.045264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 232/447] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:28 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:29.084732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:29.092623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3a8ec696-7b9a-456a-ba6f-57805209cee8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.153127 Aug 31 07:04:29.093196 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 216/448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:28 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:29.365057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:29.366024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:29.373965 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:29.374998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:29.375671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:29.377148 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:29.377818 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:29.378311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:29.608263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:29.618303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-cf52ca6d-5164-4095-81e6-e912046545e3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1359 microversion: 2.1 time: 0.259037 Aug 31 07:04:29.619831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 233/449] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:29 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:29.806097 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:29.807426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:29.816832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:29.817308 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:29.818012 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:29.818946 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:29.819593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:29.820244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:29.965217 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:29.973352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-85bb9eee-e96e-48f6-b1b1-636536e517e3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.171183 Aug 31 07:04:29.973917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 217/450] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:29 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:30.070763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:30.071566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:30.080755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.081232 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.081660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.082368 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.082793 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.083225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.114681 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:30.115429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:30.121692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.122182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.122618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.123345 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.123771 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.124228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.220893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:30.236720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:30.239117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:30.241377 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4e33e335-63b5-440e-9fda-c377091f3407 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.176473 Aug 31 07:04:30.242153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 234/451] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:30 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:30.278434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:30.286560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0f8f695a-db10-4e4f-93ee-16c20338596c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.176520 Aug 31 07:04:30.287167 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 218/452] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:30 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:30.639343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:30.639953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:30.647079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.647558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.647991 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.648675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.649121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.649538 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.784201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:30.792657 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fc3cea41-7906-41dc-888b-64f72303cfdb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1548 microversion: 2.1 time: 0.157382 Aug 31 07:04:30.793199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 235/453] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:30 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:30.813473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:30.814072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:30.820949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.821431 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.821857 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.822572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:30.823052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:30.823463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:30.961130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:30.973443 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b1fa67ad-ae15-42a0-862b-1856850a4652 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1548 microversion: 2.1 time: 0.163501 Aug 31 07:04:30.974183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 219/454] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:30 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:30.994008 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:30.994618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:30.997358 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:31.001201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.001863 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.002326 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.002465 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:31.003062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.003225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Searching by: {'deleted': False, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565'} {{(pid=120771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 07:04:31.003517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.003935 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.010081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.010546 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.011001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.011714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.012139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.012553 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.107009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.multi_cell_list [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 07:04:31.137796 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:31.146140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-665cd49e-e401-4e51-9707-cef22a6aa986 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.156055 Aug 31 07:04:31.146710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 236/455] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:30 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:31.200898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-aaabd85c-fded-4484-8397-c294f1eb6fc5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206918 Aug 31 07:04:31.201401 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 220/456] 10.222.0.42 () {58 vars in 1125 bytes} [Wed Aug 31 07:04:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:31.212908 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:31.213518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:31.219960 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.220484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.220889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.221592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.222019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.222447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.245366 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:31.266224 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:31.266954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:31.273294 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.273779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.274409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.274895 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.275346 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.275760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.360724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:31.369353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-cbdfcba9-eddd-47fd-be9a-e0ae232ee56a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1548 microversion: 2.1 time: 0.160354 Aug 31 07:04:31.369922 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 237/457] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:31 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:31.376420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:31.376420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:31.381539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.382015 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.382632 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.383359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:31.383856 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:31.384320 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:31.415558 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:31.425162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:31.426683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:31.428262 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-70ea8a89-ac21-4a9f-959b-12a25498fe9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.166008 Aug 31 07:04:31.428900 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 221/458] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:31 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:31.530426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:31.538260 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e5ef69f2-2424-4518-b61a-cc8abd7b3c9a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.167373 Aug 31 07:04:31.539220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 238/459] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:31 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:32.167574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:32.168238 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:32.175668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:32.176359 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:32.177009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:32.177782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:32.178428 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:32.179126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:32.312429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:32.320445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2bcbff43-126a-4c7c-a7dc-2beecce9459a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.157205 Aug 31 07:04:32.321013 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 222/460] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:32 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:32.451338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:32.451910 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:32.461241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:32.461874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:32.462464 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:32.463597 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:32.464216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:32.464779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:32.560322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:32.560986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:32.567679 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:32.568261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:32.568732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:32.569430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:32.569875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:32.570295 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:32.612448 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:32.621325 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:32.622760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:32.623964 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1ace50b8-dc1c-4409-bac8-723f68a6b151 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.176557 Aug 31 07:04:32.624566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 239/461] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:32 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:32.721570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:32.729335 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0d201ac8-583f-4aa0-8c28-a207d51bdfc7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.173035 Aug 31 07:04:32.730067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 223/462] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:32 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:33.344758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:33.345730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:33.352151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:33.352634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:33.353067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:33.353747 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:33.354194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:33.354607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:33.493509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:33.501435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-78d9b608-ca80-409e-98f6-808ac28bbbcc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.163553 Aug 31 07:04:33.502046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 240/463] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:33 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:33.647695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:33.648533 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:33.658776 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:33.659508 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:33.660008 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:33.661054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:33.661675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:33.662227 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:33.757435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:33.758052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:33.764750 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:33.765229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:33.765654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:33.766314 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:33.766762 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:33.767315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:33.808339 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:33.819453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:33.821135 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:33.822152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e2fc1780-d7d6-4fc1-a409-c1db5dff0857 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.178504 Aug 31 07:04:33.822741 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 224/464] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:33 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:33.921841 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:33.929943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-667dfca0-504a-4a16-90fc-3cd1f55c2bbf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.176450 Aug 31 07:04:33.930528 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 241/465] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:33 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:33.975355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-2393acb9-b021-478d-a07d-55b5afc451ce req-e830be22-f29c-4679-a257-a12c79523e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511f1298-6885-4659-86c4-2bb83fa7803b", "name": "network-vif-plugged", "status": "completed", "tag": "f1143e84-14e6-46df-9c89-a9a60f4e8a19"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:33.984897 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-2393acb9-b021-478d-a07d-55b5afc451ce req-e830be22-f29c-4679-a257-a12c79523e8a service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:33.985364 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-2393acb9-b021-478d-a07d-55b5afc451ce req-e830be22-f29c-4679-a257-a12c79523e8a service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:33.986092 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-2393acb9-b021-478d-a07d-55b5afc451ce req-e830be22-f29c-4679-a257-a12c79523e8a service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:33.997216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-2393acb9-b021-478d-a07d-55b5afc451ce req-e830be22-f29c-4679-a257-a12c79523e8a service nova] Creating event network-vif-plugged:f1143e84-14e6-46df-9c89-a9a60f4e8a19 for instance 511f1298-6885-4659-86c4-2bb83fa7803b on hv-cinder-85528 Aug 31 07:04:34.002519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-2393acb9-b021-478d-a07d-55b5afc451ce req-e830be22-f29c-4679-a257-a12c79523e8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 Aug 31 07:04:34.003213 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 225/466] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:34.521788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:34.522469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:34.529258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:34.529708 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:34.530167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:34.530876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:34.531336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:34.531773 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:34.667468 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:34.678706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2968f02b-6b91-4df5-ab73-3360804a7d6d tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1278 microversion: 2.1 time: 0.159822 Aug 31 07:04:34.679479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 242/467] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:34 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:34.846839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:34.847536 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:34.857111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:34.857710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:34.858206 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:34.858954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:34.859375 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:34.859792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:34.951690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:34.952336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:34.960253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:34.960722 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:34.961149 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:34.961849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:34.962290 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:34.962685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:35.003982 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:35.015423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:35.017177 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:35.019483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-da195bbf-8b8b-440e-8a4b-d694cbfb94fe tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.178357 Aug 31 07:04:35.020692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 226/468] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:34 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:35.061404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "305a8f87-e6a1-4f61-9684-41672a32eb5f"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:35.063759 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:35.069794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:35.070268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:35.070697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:35.071493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:35.071936 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:35.072347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:35.100073 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:35.108134 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e919f6b5-bc39-47db-a769-9b701260204c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.160896 Aug 31 07:04:35.108710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 243/469] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:34 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:35.703045 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:35.704176 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:35.715935 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:35.716733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:35.717854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:35.718710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:35.719545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:35.720034 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:35.857832 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:35.871154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d6cc2954-cc0a-4f53-968c-a8007b06cd01 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.174203 Aug 31 07:04:35.872016 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 244/470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:35 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:36.045444 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:36.046197 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:36.053153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:36.053637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:36.054065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:36.054757 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:36.055239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:36.055660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:36.188412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:36.198968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:36.201095 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:36.202824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7168c12b-8868-46a9-8423-a27dd7a68e6d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.162040 Aug 31 07:04:36.203546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 245/471] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:36 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:36.208402 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:36.208997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:36.215039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:36.215529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:36.215963 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:36.216647 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:36.217097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:36.217515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:36.352375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:36.360495 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e93806ce-6bb8-4ef1-9e0c-5f2ef96ea05a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.156010 Aug 31 07:04:36.361457 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 246/472] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:36 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:36.894063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:36.894711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:36.901770 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:36.902255 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:36.902659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:36.903384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:36.903863 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:36.904282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:37.049345 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:37.057763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-44a9be51-fe4d-40b5-88ad-f51165cff58c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.167741 Aug 31 07:04:37.058325 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 247/473] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:36 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:37.226398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:37.228325 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:37.234962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:37.235538 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:37.235975 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:37.236770 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:37.237316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:37.237738 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:37.372625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:37.382411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:37.383899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:37.385100 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-48466584-e74a-4201-b021-09539b9f913f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.162673 Aug 31 07:04:37.385693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 248/474] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:37 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:37.389975 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:37.390569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:37.396350 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:37.396830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:37.397279 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:37.397949 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:37.398391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:37.398809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:37.531663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:37.542485 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d1f2e111-ebf7-432b-ae68-52af7e25062f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.155513 Aug 31 07:04:37.543339 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 249/475] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:37 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:38.080728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:38.081461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:38.088778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:38.089272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:38.089701 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:38.090415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:38.090875 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:38.091316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:38.235702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:38.244101 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-704f49c0-6755-4602-810d-432fb7715ead tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.167431 Aug 31 07:04:38.244641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 250/476] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:38 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:38.407379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:38.408149 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:38.414775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:38.415299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:38.415727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:38.416412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:38.416880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:38.417297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:38.563302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:38.572407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:38.573854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:38.575055 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-10a89f36-0fc4-401c-98ba-820ade3cc3fb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.171675 Aug 31 07:04:38.575663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 251/477] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:38 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:38.580007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:38.580919 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:38.587320 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:38.587795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:38.588229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:38.588898 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:38.589343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:38.589753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:38.733003 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-33fb848a-0f74-43d8-b7d5-89d3e3309e35 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.675225 Aug 31 07:04:38.735171 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 227/478] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:04:35 2022] POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments => generated 194 bytes in 3678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:04:38.837768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:38.848882 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1ceecc0c-bb57-406a-868d-206515b2f888 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.272203 Aug 31 07:04:38.849542 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 252/479] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:38 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:39.265857 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:39.266545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:39.273721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:39.274202 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:39.274633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:39.275351 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:39.275800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:39.276218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:39.422119 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:39.430067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2028179f-1477-425b-9fa0-b0e3f9dfbf70 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.169003 Aug 31 07:04:39.430638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 228/480] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:39 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:39.529602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-612d7119-c9b2-48ae-97bf-e9fe9135d36c req-76fd4189-37ab-4b0c-b80e-38d6a6022d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336cfa5e-6e07-45f0-af84-07847284d723", "name": "network-vif-plugged", "status": "completed", "tag": "6a3a3984-9c5f-43b0-817c-b3924c1cd829"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:39.540751 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-612d7119-c9b2-48ae-97bf-e9fe9135d36c req-76fd4189-37ab-4b0c-b80e-38d6a6022d08 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:39.541225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-612d7119-c9b2-48ae-97bf-e9fe9135d36c req-76fd4189-37ab-4b0c-b80e-38d6a6022d08 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:39.541675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-612d7119-c9b2-48ae-97bf-e9fe9135d36c req-76fd4189-37ab-4b0c-b80e-38d6a6022d08 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:39.554230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-612d7119-c9b2-48ae-97bf-e9fe9135d36c req-76fd4189-37ab-4b0c-b80e-38d6a6022d08 service nova] Creating event network-vif-plugged:6a3a3984-9c5f-43b0-817c-b3924c1cd829 for instance 336cfa5e-6e07-45f0-af84-07847284d723 on hv-cinder-85528 Aug 31 07:04:39.559319 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-612d7119-c9b2-48ae-97bf-e9fe9135d36c req-76fd4189-37ab-4b0c-b80e-38d6a6022d08 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033390 Aug 31 07:04:39.560052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 253/481] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:39.598225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:39.599029 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:39.605653 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:39.606132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:39.606558 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:39.607258 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:39.607730 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:39.608147 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:39.744552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:39.753425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:39.754875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:39.756000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f6748842-4b69-4332-999b-69a15298c47c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.162183 Aug 31 07:04:39.756558 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 229/482] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:39 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:39.870651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:39.871369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:39.878128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:39.878678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:39.879180 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:39.879932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:39.880478 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:39.880923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:40.026516 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:40.031135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:40.039421 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f3e03293-88e1-4cfb-8196-ba15e7689e52 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.172249 Aug 31 07:04:40.039992 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 254/483] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:39 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:40.452992 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:40.453616 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:40.456607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=92 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:40.462281 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:40.462758 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:40.463210 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:40.463888 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:40.464339 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:40.464750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:40.481721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:40.605585 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:40.616250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5d0828d2-29dd-4203-a168-87adeea7cef1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.167377 Aug 31 07:04:40.616819 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 230/484] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:40 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:40.782263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:40.783530 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:40.790670 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:40.791175 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:40.791605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:40.792288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:40.792732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:40.793150 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:40.931782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:40.940903 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:40.942349 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:40.943533 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-dbca663b-2d92-44be-bd20-6939692cf488 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.167837 Aug 31 07:04:40.944097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 255/485] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:40 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:41.062086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:41.062875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:41.065437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:41.070959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:41.071445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:41.071877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:41.072567 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:41.073021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:41.073438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:41.207216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:41.215129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-27d8cc8d-b8ad-4ac6-a361-021cb1fbf3e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.158121 Aug 31 07:04:41.215683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 231/486] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:41 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:41.637465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:41.637960 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:41.644188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:41.644641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:41.645065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:41.645959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:41.646398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:41.646816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:41.784788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:41.793326 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-dc7badd3-1c83-4bb8-ba16-896237503fa7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.159916 Aug 31 07:04:41.793874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 256/487] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:41 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:41.966096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:41.966754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:41.973429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:41.973912 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:41.974341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:41.975062 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:41.975509 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:41.975977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:42.115927 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:42.129720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:42.132072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:42.133879 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3e9405cd-3da8-43f6-8aca-c18b3f4e3c18 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1810 microversion: 2.20 time: 0.171462 Aug 31 07:04:42.134755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 232/488] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:41 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:42.216109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:42.216821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:42.226310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:42.226795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:42.227273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:42.227965 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:42.228418 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:42.228824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:42.236394 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:42.237131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:42.243384 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:42.243868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:42.244293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:42.244980 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:42.245424 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:42.245839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:42.364888 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lazy-loading 'services' on Instance uuid 0025cad0-8546-4427-b5c7-fc85d557bdc6 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:04:42.376967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:42.385277 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e8e4e76b-933c-4e47-a7e8-1209f4cb7cc6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1367 microversion: 2.1 time: 0.152713 Aug 31 07:04:42.385805 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 233/489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:42 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:42.503263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8589a22c-d86d-4c6f-881e-6f05bd5ec3f3 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6/os-volume_attachments/d91dcd40-fc93-48c3-b1eb-ea0505324805" status: 202 len: 0 microversion: 2.1 time: 0.293495 Aug 31 07:04:42.503948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 257/490] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:04:42 2022] DELETE /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6/os-volume_attachments/d91dcd40-fc93-48c3-b1eb-ea0505324805 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:04:42.817947 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:42.818959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:42.828752 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:42.829519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:42.830222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:42.831188 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:42.831648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:42.832065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:42.989607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:42.997610 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cd0fd618-b0cf-4347-a758-9deea789ab8f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.185899 Aug 31 07:04:42.998228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 234/491] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:42 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:43.165962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:43.166770 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:43.177164 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:43.177887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:43.178522 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:43.179560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:43.180212 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:43.180783 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:43.314668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:43.323467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:43.324899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:43.326049 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8b033571-8401-4256-8dc8-dc1a186a8a84 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1797 microversion: 2.20 time: 0.167856 Aug 31 07:04:43.326723 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 258/492] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:04:43 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1797 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:04:43.410775 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:43.411826 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:43.422546 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:43.423321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:43.424049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:43.424907 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:43.425352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:43.425773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:43.555650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:43.564254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a6f1fea7-4e1c-4161-b870-03473afe3ae6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1557 microversion: 2.1 time: 0.159995 Aug 31 07:04:43.564918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 235/493] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:43 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:43.584968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:43.585527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:43.591699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:43.592282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:43.592778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:43.593535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:43.594052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:43.602521 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:43.689623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-9f7431da-e865-4a30-bb76-ed6ef33ff621 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108269 Aug 31 07:04:43.690742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 259/494] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:04:43 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:44.017905 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:44.018886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:44.025240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:44.025818 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:44.026429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:44.027153 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:44.027597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:44.028014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:44.181524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:44.191667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bc90e31a-2db7-4156-9b00-40744f2a5dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.177606 Aug 31 07:04:44.192233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 236/495] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:44 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:44.257933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:44.258540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:44.264607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:44.265086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:44.265517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:44.266191 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:44.266642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:44.267097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:44.483445 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:44.492419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e51c7a95-ec01-44dd-9714-864c31b84545 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1594 microversion: 2.1 time: 0.238760 Aug 31 07:04:44.492961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 260/496] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:44 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1594 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:44.982535 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-309a7990-a26d-42ac-a3fa-6f80af763376 req-9ac2e6ee-b581-4f01-8829-1b2ba8ae0c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336cfa5e-6e07-45f0-af84-07847284d723", "tag": "6a3a3984-9c5f-43b0-817c-b3924c1cd829"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:44.992494 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-309a7990-a26d-42ac-a3fa-6f80af763376 req-9ac2e6ee-b581-4f01-8829-1b2ba8ae0c43 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:44.992969 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-309a7990-a26d-42ac-a3fa-6f80af763376 req-9ac2e6ee-b581-4f01-8829-1b2ba8ae0c43 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:44.993439 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-309a7990-a26d-42ac-a3fa-6f80af763376 req-9ac2e6ee-b581-4f01-8829-1b2ba8ae0c43 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:45.005628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-309a7990-a26d-42ac-a3fa-6f80af763376 req-9ac2e6ee-b581-4f01-8829-1b2ba8ae0c43 service nova] Creating event network-changed:6a3a3984-9c5f-43b0-817c-b3924c1cd829 for instance 336cfa5e-6e07-45f0-af84-07847284d723 on hv-cinder-85528 Aug 31 07:04:45.011225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-309a7990-a26d-42ac-a3fa-6f80af763376 req-9ac2e6ee-b581-4f01-8829-1b2ba8ae0c43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032273 Aug 31 07:04:45.012483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 237/497] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:45.216300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:45.216923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:45.223672 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:45.224443 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:45.224871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:45.225571 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:45.226196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:45.226615 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:45.368422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:45.378066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-353524f4-9d99-414d-b1a3-bd4d83356968 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.164799 Aug 31 07:04:45.393144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 261/498] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:45 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:46.402098 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:46.415893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:46.421996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:46.422462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:46.422912 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:46.425155 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:46.425638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:46.426065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:46.617087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:46.632821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-bacaec53-cb1d-40fb-bb45-645c1d1afb81 req-e73c2bdb-1933-48b2-80d9-6ac6853b817f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55", "tag": "585a62c3-8f91-41fd-81cc-fa2d04d1cc78"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:46.639586 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bf1628a4-c0c0-4475-8fdb-7c3902f39d2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.242594 Aug 31 07:04:46.646395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 238/499] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:46 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:46.649906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-bacaec53-cb1d-40fb-bb45-645c1d1afb81 req-e73c2bdb-1933-48b2-80d9-6ac6853b817f service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:46.651141 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-bacaec53-cb1d-40fb-bb45-645c1d1afb81 req-e73c2bdb-1933-48b2-80d9-6ac6853b817f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:46.651732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-bacaec53-cb1d-40fb-bb45-645c1d1afb81 req-e73c2bdb-1933-48b2-80d9-6ac6853b817f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:46.666734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-bacaec53-cb1d-40fb-bb45-645c1d1afb81 req-e73c2bdb-1933-48b2-80d9-6ac6853b817f service nova] Creating event network-changed:585a62c3-8f91-41fd-81cc-fa2d04d1cc78 for instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 on hv-cinder-85528 Aug 31 07:04:46.675617 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-bacaec53-cb1d-40fb-bb45-645c1d1afb81 req-e73c2bdb-1933-48b2-80d9-6ac6853b817f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047220 Aug 31 07:04:46.676907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 262/500] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:46.878145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:46.878865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:46.887677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:46.888506 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:46.889164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:46.890632 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:46.891291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:46.892115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:46.924198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:04:47.053411 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5fcc7888-8cc4-4cbe-98d3-a815573fb87e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 204 len: 0 microversion: 2.1 time: 0.180869 Aug 31 07:04:47.054829 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 239/501] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:04:46 2022] DELETE /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:04:47.064547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:47.066214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:47.083250 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:47.084176 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:47.084869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:47.085889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:47.087102 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:47.087902 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:47.256167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:47.265099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-801d118a-64e6-4895-b0d8-1a0e17759f89 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1513 microversion: 2.1 time: 0.206072 Aug 31 07:04:47.266114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 263/502] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:47 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:47.666600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:47.668086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:47.700800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:47.701317 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:47.701760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:47.702616 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:47.702937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:47.707494 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:47.839149 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1561760453"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:47.839782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:47.848546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:47.849061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:47.850086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:47.850946 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:47.851297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:47.851719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:47.875586 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:47.889726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-af5fe0db-b279-4f63-a15f-727fe3c27edb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.228605 Aug 31 07:04:47.899523 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 240/503] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:47 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:47.988334 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.network.security_group_api [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Adding security group 42bc2b70-11e7-44a1-8937-b4478c3f3ade to port 585a62c3-8f91-41fd-81cc-fa2d04d1cc78 Aug 31 07:04:48.288303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:48.288904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:48.297082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:48.297877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:48.298481 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:48.299779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:48.300772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:48.301416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:48.358342 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7d550674-ecbd-4381-9471-cbdcb1fea067 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/action" status: 202 len: 0 microversion: 2.1 time: 0.524179 Aug 31 07:04:48.359188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 264/504] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:04:47 2022] POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 07:04:48.367285 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:48.368507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:48.374871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:48.375361 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:48.375968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:48.377128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:48.378046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:48.378720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:48.449682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:48.460218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1f2214fd-6fc0-4d6d-b2c4-b8f51e4ca81a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1513 microversion: 2.1 time: 0.175785 Aug 31 07:04:48.463686 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 241/505] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:48 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:48.468590 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-141573bd-2b04-40ce-95a9-bb5b151168f7 req-0be2d9ac-d1f4-4661-9f0e-742a1dea34c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55", "tag": "585a62c3-8f91-41fd-81cc-fa2d04d1cc78"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:48.488380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-141573bd-2b04-40ce-95a9-bb5b151168f7 req-0be2d9ac-d1f4-4661-9f0e-742a1dea34c8 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:48.489102 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-141573bd-2b04-40ce-95a9-bb5b151168f7 req-0be2d9ac-d1f4-4661-9f0e-742a1dea34c8 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:48.489518 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-141573bd-2b04-40ce-95a9-bb5b151168f7 req-0be2d9ac-d1f4-4661-9f0e-742a1dea34c8 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:48.502812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-141573bd-2b04-40ce-95a9-bb5b151168f7 req-0be2d9ac-d1f4-4661-9f0e-742a1dea34c8 service nova] Creating event network-changed:585a62c3-8f91-41fd-81cc-fa2d04d1cc78 for instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 on hv-cinder-85528 Aug 31 07:04:48.508200 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-141573bd-2b04-40ce-95a9-bb5b151168f7 req-0be2d9ac-d1f4-4661-9f0e-742a1dea34c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044655 Aug 31 07:04:48.508812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 242/506] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:48.570817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:48.579123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-168712db-6c38-45bc-a0f5-2dd4edb78a81 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1641 microversion: 2.1 time: 0.215592 Aug 31 07:04:48.579706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 265/507] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:48 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1641 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:04:48.910446 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:48.911150 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:48.918802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:48.919310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:48.919734 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:48.920423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:48.920863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:48.921284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:49.057720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:49.067099 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-09ae3d94-244d-4802-87c2-852e762eeacc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.160885 Aug 31 07:04:49.067807 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 243/508] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:48 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:49.481874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:49.482448 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:49.489769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:49.490181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:49.490608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:49.491319 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:49.491766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:49.492154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:49.689414 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:49.701282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-78e13553-a01b-4a80-97aa-471907679697 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1513 microversion: 2.1 time: 0.223056 Aug 31 07:04:49.702053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 266/509] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:49 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:50.090820 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:50.091749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:50.098768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:50.099353 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:50.099827 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:50.100732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:50.101236 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:50.101731 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:50.285340 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-2f5a4f9a-dd65-43bf-ac6e-521ad9b1a426 req-72794260-4419-42c4-9665-9c0948981257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0025cad0-8546-4427-b5c7-fc85d557bdc6", "name": "network-vif-deleted", "tag": "e335eb05-f8e3-4b1d-9a6f-052ca29f440d"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:50.300291 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2f5a4f9a-dd65-43bf-ac6e-521ad9b1a426 req-72794260-4419-42c4-9665-9c0948981257 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:50.301023 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2f5a4f9a-dd65-43bf-ac6e-521ad9b1a426 req-72794260-4419-42c4-9665-9c0948981257 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:50.301627 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2f5a4f9a-dd65-43bf-ac6e-521ad9b1a426 req-72794260-4419-42c4-9665-9c0948981257 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:50.316766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:50.317426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-2f5a4f9a-dd65-43bf-ac6e-521ad9b1a426 req-72794260-4419-42c4-9665-9c0948981257 service nova] Creating event network-vif-deleted:e335eb05-f8e3-4b1d-9a6f-052ca29f440d for instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 on hv-cinder-85528 Aug 31 07:04:50.322898 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-2f5a4f9a-dd65-43bf-ac6e-521ad9b1a426 req-72794260-4419-42c4-9665-9c0948981257 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042417 Aug 31 07:04:50.324954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2179a86c-5323-4638-a1c3-71b8ff8187d9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.240568 Aug 31 07:04:50.326758 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 244/510] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:50 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:50.327394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 267/511] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:50.660106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-d6ac589b-f0cd-4b84-a9d6-f62effba4849 req-4f3c55c0-f741-4149-a369-e038b77d879c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de723bf7-b3b4-4f94-ac57-188c9b729f30", "name": "network-vif-plugged", "status": "completed", "tag": "9129b959-b9e7-4911-91eb-bce08274bbed"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:50.670837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-d6ac589b-f0cd-4b84-a9d6-f62effba4849 req-4f3c55c0-f741-4149-a369-e038b77d879c service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:50.671363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-d6ac589b-f0cd-4b84-a9d6-f62effba4849 req-4f3c55c0-f741-4149-a369-e038b77d879c service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:50.671782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-d6ac589b-f0cd-4b84-a9d6-f62effba4849 req-4f3c55c0-f741-4149-a369-e038b77d879c service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:50.683522 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-d6ac589b-f0cd-4b84-a9d6-f62effba4849 req-4f3c55c0-f741-4149-a369-e038b77d879c service nova] Creating event network-vif-plugged:9129b959-b9e7-4911-91eb-bce08274bbed for instance de723bf7-b3b4-4f94-ac57-188c9b729f30 on hv-cinder-85528 Aug 31 07:04:50.688914 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-d6ac589b-f0cd-4b84-a9d6-f62effba4849 req-4f3c55c0-f741-4149-a369-e038b77d879c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033575 Aug 31 07:04:50.689511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 245/512] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:04:50.724683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:50.725413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:50.731738 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:50.732221 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:50.732648 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:50.733331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:50.733780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:50.734199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:50.767348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:50.767761 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:50.768204 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:50.768676 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lazy-loading 'fault' on Instance uuid 0025cad0-8546-4427-b5c7-fc85d557bdc6 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:04:50.816856 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:50.824727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-41846339-a14d-4462-a356-ab7584d1813a tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 200 len: 1308 microversion: 2.1 time: 0.105214 Aug 31 07:04:50.825331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 268/513] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:50 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:51.350700 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:51.351403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:51.358563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:51.359081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:51.359511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:51.360198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:51.360648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:51.361062 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:51.506917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:51.519865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dbba4e99-609b-4a41-b8d9-e37ac8c0a6fa tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.173687 Aug 31 07:04:51.520612 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 246/514] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:51 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:51.850007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:51.851043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 0025cad0-8546-4427-b5c7-fc85d557bdc6] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:51.862238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:51.862712 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:51.863182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:51.863866 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:51.864308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:51.864719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:51.880233 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] HTTP exception thrown: Instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 could not be found. Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Request method failure captured: Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 HTTP/1.1 Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwetldNL96vimD9BohFQtCS7a519lMbVD8YSp3Qxq9BWrqBBZNfLsPdm7HAKwtWzehBs7859f_GWCCKC50uMYizXC2knRqRH0q9GC-VJhkbjM8FwG6rS1E_VFE9I9nSvkNuRZOPpn0BoqGIxi6LjCqQW0O3OEj9HpVkJrPd3YVyTXNk Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: f1c80a72cf6844c3afd353461c55e580 Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1594799693 Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:04:51.881889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1c80a72cf6844c3afd353461c55e580"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1c80a72cf6844c3afd353461c55e580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1c80a72cf6844c3afd353461c55e580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1c80a72cf6844c3afd353461c55e580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesSnapshotTestJSON-1594799693 Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: f1c80a72cf6844c3afd353461c55e580 Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1594799693 Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesSnapshotTestJSON-1594799693-project Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 317bddaf96694853b3e029b2d23af87f Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesSnapshotTestJSON-1594799693-project Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 could not be found. Aug 31 07:04:51.883262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '0025cad0-8546-4427-b5c7-fc85d557bdc6'} Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 could not be found. Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:04:51.884077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 could not be found. Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 could not be found. Aug 31 07:04:51.885482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:04:51.886877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Returning 404 to user: Instance 0025cad0-8546-4427-b5c7-fc85d557bdc6 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:04:51.886877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-004c7823-2f43-426e-a390-2b48f1355ec7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6" status: 404 len: 111 microversion: 2.1 time: 0.040158 Aug 31 07:04:51.886877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 269/515] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:51 2022] GET /compute/v2.1/servers/0025cad0-8546-4427-b5c7-fc85d557bdc6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:04:52.550449 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:52.551082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:52.558410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:52.558952 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:52.559410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:52.560133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:52.560602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:52.561046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:52.577008 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:52.701327 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:52.710312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-628723b1-8296-4ab4-b54c-f8d630c4a341 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.166274 Aug 31 07:04:52.710873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 247/516] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:52 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:53.732042 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:53.732621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:53.740086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:53.740560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:53.740986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:53.741667 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:53.742109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:53.742523 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:53.877167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:53.885557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-358007d4-643c-44e1-847a-d350c75544f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.157473 Aug 31 07:04:53.886097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 270/517] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:53 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:54.910001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:54.910633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:54.920000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:54.920631 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:54.921249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:54.922257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:54.922901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:54.923541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:55.059389 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:55.069420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-44bfd62a-590a-4577-890c-28f7291cb27b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1266 microversion: 2.1 time: 0.163414 Aug 31 07:04:55.069998 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 248/518] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:54 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:56.097251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:56.098386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:56.101227 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=97 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:56.107350 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:56.107880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:56.108364 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:56.109126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:56.109632 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:56.110098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:56.247355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:56.255337 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2fb10614-e43f-4648-bdf9-4ef0a55220ea tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1452 microversion: 2.1 time: 0.164670 Aug 31 07:04:56.255910 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 271/519] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:56 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:56.275921 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:04:56.276580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:56.283424 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:56.283904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:56.284335 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:56.285022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:56.285500 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:56.286218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:56.338605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e596e93-ec30-4c6d-b072-42eecd2bc7d7"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:56.341034 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:04:56.347608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:56.348070 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:56.348506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:56.349223 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:56.349663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:56.350083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:56.433537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:04:56.441296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-65af0a98-c49c-463d-ae51-e27cc9d91f47 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1452 microversion: 2.1 time: 0.169277 Aug 31 07:04:56.441906 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 249/520] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:04:56 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:04:56.526281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:04:56.657384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-40e41c88-a4df-4ac8-9e71-5ba15b3f8bd8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322648 Aug 31 07:04:56.658001 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 272/521] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:04:56 2022] POST /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:04:58.344882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-ee16c416-b92a-47a2-b4f9-518e390aba5d req-36b810a3-46f3-4fb1-95fd-4cbae56152e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de723bf7-b3b4-4f94-ac57-188c9b729f30", "tag": "9129b959-b9e7-4911-91eb-bce08274bbed"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:04:58.356309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-ee16c416-b92a-47a2-b4f9-518e390aba5d req-36b810a3-46f3-4fb1-95fd-4cbae56152e0 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:04:58.356785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-ee16c416-b92a-47a2-b4f9-518e390aba5d req-36b810a3-46f3-4fb1-95fd-4cbae56152e0 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:04:58.357212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-ee16c416-b92a-47a2-b4f9-518e390aba5d req-36b810a3-46f3-4fb1-95fd-4cbae56152e0 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:04:58.368776 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-ee16c416-b92a-47a2-b4f9-518e390aba5d req-36b810a3-46f3-4fb1-95fd-4cbae56152e0 service nova] Creating event network-changed:9129b959-b9e7-4911-91eb-bce08274bbed for instance de723bf7-b3b4-4f94-ac57-188c9b729f30 on hv-cinder-85528 Aug 31 07:04:58.373745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-ee16c416-b92a-47a2-b4f9-518e390aba5d req-36b810a3-46f3-4fb1-95fd-4cbae56152e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032630 Aug 31 07:04:58.374320 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 250/522] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:01.863865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-923205053", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "networks": [{"uuid": "5f7a7893-0580-45a3-a56f-f043fba77ea0"}]}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:01.922967 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.network.neutron [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] validate_networks() for [('5f7a7893-0580-45a3-a56f-f043fba77ea0', None, None, None, None, None)] {{(pid=120770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:05:02.289114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Flavor limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:05:02.289892 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Image limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:05:02.290391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Flavor pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:05:02.290784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Image pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:05:02.291216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:05:02.300564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:02.301042 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:02.301472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:02.302177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:02.302825 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:02.303330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:02.320410 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Getting quotas for project f1c80a72cf6844c3afd353461c55e580. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:05:02.324382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Getting quotas for user 317bddaf96694853b3e029b2d23af87f and project f1c80a72cf6844c3afd353461c55e580. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:05:02.335272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Going to run 1 instances... {{(pid=120770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:05:02.337624 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:05:02.385736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-47b32c0b-91d9-4180-a69f-cded3b257687 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527139 Aug 31 07:05:02.386373 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 273/523] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:05:02.398038 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-92278e78-464e-457e-b847-ed8850673862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:02.398751 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-92278e78-464e-457e-b847-ed8850673862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:02.458064 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-92278e78-464e-457e-b847-ed8850673862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:02.465212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-92278e78-464e-457e-b847-ed8850673862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1218 microversion: 2.1 time: 0.071591 Aug 31 07:05:02.465785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 251/524] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:02 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:03.486355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:03.486984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:03.494079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:03.494564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:03.495114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:03.496421 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:03.497803 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:03.498436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:03.563269 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:03.571682 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fa3330aa-752a-43cf-a4f5-89057af53141 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1214 microversion: 2.1 time: 0.089906 Aug 31 07:05:03.572240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 274/525] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:03 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:04.601127 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:04.602247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:04.614577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:04.615464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:04.616381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:04.617075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:04.617528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:04.617950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:04.685840 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:04.695846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-099f87b4-2adf-4214-a54b-68af9c204d72 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1270 microversion: 2.1 time: 0.101202 Aug 31 07:05:04.696434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 252/526] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:04 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:05.282743 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:05.285073 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:05.292477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:05.292959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:05.293384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:05.294037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:05.294478 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:05.294920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:05.319784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lazy-loading 'flavor' on Instance uuid da8ac19a-b609-4d5a-93ce-78a6abc0ee1d {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:05:05.449034 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-9141acbc-95a5-4b4c-a096-84621fa73306 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/action" status: 200 len: 32 microversion: 2.1 time: 0.170259 Aug 31 07:05:05.449681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 275/527] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:05:05 2022] POST /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:05:05.459426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:05.460266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:05.466505 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:05.467024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:05.467459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:05.468145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:05.468590 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:05.469006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:05.608235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:05.618020 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b2e69fc5-56dc-44ee-8fbc-ba1309c36a1f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.162548 Aug 31 07:05:05.618597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 253/528] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:05 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:05.717401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:05.718290 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:05.725817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:05.727912 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:05.728584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:05.729270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:05.729876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:05.730290 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:05.950074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:05.958541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1464e88d-1e56-411c-939a-e44615cb8d21 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.246065 Aug 31 07:05:05.971477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 276/529] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:05 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:06.456687 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-b9080ac9-8842-46da-b148-cc6e13f3defc req-0820da1b-7008-4e0f-b84a-dcee8242607f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a860b25-77ef-4144-bbde-d2dae011247e", "tag": "cbae97a7-477d-467f-a117-4502e24cbd55"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:06.466378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-b9080ac9-8842-46da-b148-cc6e13f3defc req-0820da1b-7008-4e0f-b84a-dcee8242607f service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:06.466862 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-b9080ac9-8842-46da-b148-cc6e13f3defc req-0820da1b-7008-4e0f-b84a-dcee8242607f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:06.467714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-b9080ac9-8842-46da-b148-cc6e13f3defc req-0820da1b-7008-4e0f-b84a-dcee8242607f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:06.480974 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-b9080ac9-8842-46da-b148-cc6e13f3defc req-0820da1b-7008-4e0f-b84a-dcee8242607f service nova] Creating event network-changed:cbae97a7-477d-467f-a117-4502e24cbd55 for instance 3a860b25-77ef-4144-bbde-d2dae011247e on hv-cinder-85528 Aug 31 07:05:06.486280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-b9080ac9-8842-46da-b148-cc6e13f3defc req-0820da1b-7008-4e0f-b84a-dcee8242607f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032979 Aug 31 07:05:06.486768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 254/530] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:06.639112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:06.639851 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:06.646877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:06.647389 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:06.648543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:06.649252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:06.649709 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:06.650136 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:06.869506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:06.878719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bc20db36-cfaf-435a-a8a3-988926a13757 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.243561 Aug 31 07:05:06.879773 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 277/531] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:06 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:06.982060 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:06.982834 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:06.989390 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:06.990007 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:06.990445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:06.991498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:06.991882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:06.992589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:07.127847 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:07.136110 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8b393b1d-307c-4329-a958-a8cd8d2ba0f7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.158986 Aug 31 07:05:07.136686 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 255/532] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:06 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:07.902698 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:07.903336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:07.911014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:07.911580 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:07.912081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:07.912877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:07.913935 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:07.914774 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:08.055241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:08.064286 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a3faae60-52e8-4710-935a-057fd7b51c5b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.166580 Aug 31 07:05:08.064841 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 278/533] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:07 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:08.159816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:08.160389 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:08.168732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:08.169233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:08.169645 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:08.170337 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:08.170782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:08.171247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:08.307567 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:08.315466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-597000e0-6db9-4416-a533-7724ea3027c5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.161982 Aug 31 07:05:08.316049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 256/534] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:08 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:09.098152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:09.099007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:09.107088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:09.107575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:09.108010 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:09.108708 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:09.109156 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:09.109577 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:09.250110 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:09.263783 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-79815c0a-3182-4bf4-954d-c65e24039c6f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.171849 Aug 31 07:05:09.264515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 279/535] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:09 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:09.336837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:09.337583 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:09.344455 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:09.344928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:09.345360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:09.346045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:09.346491 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:09.346937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:09.486870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:09.495148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a08a4381-8360-4dee-81bc-e9f54572c443 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.162245 Aug 31 07:05:09.495718 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 257/536] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:09 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:10.293806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:10.294868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:10.306056 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:10.306561 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:10.307043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:10.307732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:10.308188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:10.308609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:10.443508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:10.452394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f481127a-7eb6-49c0-a729-4b9d7fe2e9e1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.166028 Aug 31 07:05:10.452995 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 280/537] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:10 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:10.515934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:10.516511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:10.519093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:10.524816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:10.525407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:10.525839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:10.526524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:10.526999 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:10.527413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:10.663930 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:10.672230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7e077648-cc5a-4502-8a89-a782ac4009ae tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.160283 Aug 31 07:05:10.672808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 258/538] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:10 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:11.476381 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:11.477241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:11.486937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:11.487552 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:11.488173 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:11.489146 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:11.489789 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:11.490395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:11.637068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:11.645561 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f2594c77-f65a-4e74-ba80-01556e0dd750 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.174982 Aug 31 07:05:11.646130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 281/539] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:11 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:11.693715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:11.694267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:11.701260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:11.701747 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:11.702185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:11.702875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:11.703371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:11.703796 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:11.843672 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:11.852715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0c677e0e-7fe3-4fcd-9095-f25a13e841a8 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.162683 Aug 31 07:05:11.853180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 259/540] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:11 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:12.102768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-286c6b86-0dab-4fc6-8c8e-fb536616daf2 req-b69d279d-fe36-4343-9637-ae43d6822731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a860b25-77ef-4144-bbde-d2dae011247e", "name": "network-vif-plugged", "status": "completed", "tag": "cbae97a7-477d-467f-a117-4502e24cbd55"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:12.112671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-286c6b86-0dab-4fc6-8c8e-fb536616daf2 req-b69d279d-fe36-4343-9637-ae43d6822731 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:12.113159 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-286c6b86-0dab-4fc6-8c8e-fb536616daf2 req-b69d279d-fe36-4343-9637-ae43d6822731 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:12.113592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-286c6b86-0dab-4fc6-8c8e-fb536616daf2 req-b69d279d-fe36-4343-9637-ae43d6822731 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:12.125449 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-286c6b86-0dab-4fc6-8c8e-fb536616daf2 req-b69d279d-fe36-4343-9637-ae43d6822731 service nova] Creating event network-vif-plugged:cbae97a7-477d-467f-a117-4502e24cbd55 for instance 3a860b25-77ef-4144-bbde-d2dae011247e on hv-cinder-85528 Aug 31 07:05:12.130276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-286c6b86-0dab-4fc6-8c8e-fb536616daf2 req-b69d279d-fe36-4343-9637-ae43d6822731 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031423 Aug 31 07:05:12.130963 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 282/541] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:12.671142 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:12.672022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:12.675170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:12.684710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:12.685502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:12.686247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:12.687438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:12.688187 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:12.688893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:12.827747 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:12.838497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-757b25c8-dbb0-4435-ada9-3580178e00cd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.174516 Aug 31 07:05:12.839120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 260/542] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:12 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:12.870927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:12.871728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=6 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:12.876200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:12.876897 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:12.884324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:12.885105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:12.885534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:12.886217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:12.886664 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:12.887112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:13.017799 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:13.025702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ec2dc51e-3829-4f98-af87-a9976c13ad18 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.155743 Aug 31 07:05:13.026399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 283/543] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:12 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:13.863010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:13.863950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:13.873043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:13.873621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:13.874052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:13.874723 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:13.875222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:13.875613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:14.025247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:14.033721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b608fb45-62a6-48c6-9004-0c1dd245d02a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.177281 Aug 31 07:05:14.034287 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 261/544] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:13 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:14.053740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:14.054347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:14.061094 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:14.061578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:14.062013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:14.062696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:14.063312 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:14.063737 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:14.206024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:14.217004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c8c7a16c-624a-4a6b-93c5-6cd637e3bab5 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1318 microversion: 2.1 time: 0.166907 Aug 31 07:05:14.217707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 284/545] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:14 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:15.055596 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:15.056457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:15.065713 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:15.066597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:15.067457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:15.068766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:15.069613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:15.070415 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:15.222024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:15.231283 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e4ed20d0-8a9f-41e0-9fc2-ac29a5c001af tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.179798 Aug 31 07:05:15.232221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 262/546] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:15 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:15.240834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:15.241472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:15.248613 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:15.249098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:15.249529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:15.250218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:15.250665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:15.251135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:15.382773 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:15.391316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e9f08cb3-d518-424c-a3da-1e673847cd50 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1507 microversion: 2.1 time: 0.154247 Aug 31 07:05:15.391856 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 285/547] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:15 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:15.414119 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "952a8cf0-a77e-4703-9abb-a936e1d4f0c7", "device": "/dev/sdb"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:15.418610 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:15.427211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:15.427864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:15.428449 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:15.429399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:15.429990 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:15.430555 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:15.727257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-90917184-cc1a-4a22-9197-ae37ed7f8cad tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "POST /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319310 Aug 31 07:05:15.727893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 263/548] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:05:15 2022] POST /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:16.252758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:16.253340 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:16.260505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:16.260982 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:16.261411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:16.262096 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:16.262544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:16.263192 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:16.399111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:16.408261 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-64fb43a7-b018-434a-a773-f6df5f083983 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.159463 Aug 31 07:05:16.408827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 286/549] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:16 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:17.435661 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:17.436376 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:17.443533 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:17.444037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:17.444493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:17.445227 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:17.445700 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:17.446139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:17.585851 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:17.595699 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-38b938b1-09dc-4955-a512-36019977a423 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.167424 Aug 31 07:05:17.596266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 264/550] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:17 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:18.621252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:18.622577 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:18.633775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:18.634619 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:18.635389 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:18.636543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:18.637291 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:18.638156 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:18.770601 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:18.774142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:18.780038 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-762ed420-e5de-4b1c-87bf-80dd83973427 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.165477 Aug 31 07:05:18.780612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 287/551] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:18 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:19.805568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:19.806183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:19.814861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:19.815351 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:19.815780 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:19.816457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:19.816909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:19.817330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:19.820043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:19.958241 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:19.970615 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-425e8583-f71f-49f4-8a2c-c85ecb8733d5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.171395 Aug 31 07:05:19.971676 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 265/552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:19 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:20.997817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:20.998920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:21.010717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:21.011624 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:21.012315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:21.013498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:21.014437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:21.014872 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:21.149980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:21.158747 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0ac63c80-472d-4c28-aead-ae5aaf9ba21e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.167418 Aug 31 07:05:21.159351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 288/553] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:20 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:22.181115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:22.181713 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:22.188800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:22.189273 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:22.189697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:22.190406 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:22.190822 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:22.191266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:22.336474 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:22.345755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3e35b086-b54a-4789-8cd1-416e6994cec3 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.168504 Aug 31 07:05:22.346325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 266/554] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:22 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:23.366858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:23.367898 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:23.375394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:23.376015 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:23.376690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:23.378013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:23.378602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:23.380457 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:23.513368 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:23.521709 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-da0a16c5-a1c0-46aa-bdb6-a748eaa7f4a8 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.158904 Aug 31 07:05:23.522282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 289/555] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:23 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:24.546398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:24.547102 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:24.554427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:24.554896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:24.555354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:24.556045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:24.556496 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:24.556932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:24.696996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:24.705927 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b949c55e-a7ff-44aa-8877-b37da73d1c07 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.165655 Aug 31 07:05:24.706493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 267/556] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:24 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:25.738952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:25.739970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:25.750205 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:25.750683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:25.751147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:25.751828 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:25.752270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:25.752681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:25.896854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:25.906475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fc7a34c5-c161-44c3-a026-ea6e74966835 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.174509 Aug 31 07:05:25.907248 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 290/557] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:25 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:26.929762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:26.930694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:26.939785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:26.940427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:26.941040 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:26.941961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:26.942562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:26.943191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:27.089860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:27.098564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-14b24f54-c7af-43e0-b402-3df805191503 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.174035 Aug 31 07:05:27.099157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 268/558] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:26 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:28.129582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:28.130200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:28.132934 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:28.139475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:28.140028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:28.140531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:28.141328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:28.141846 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:28.142333 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:28.273488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:28.282398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-569df0c9-5494-4e9d-9544-5a1eb07588b1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.157799 Aug 31 07:05:28.282962 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 291/559] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:28 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:29.311502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:29.312663 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:29.319489 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:29.319961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:29.320389 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:29.321070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:29.321514 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:29.321932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:29.460104 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:29.468648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d3116e74-4292-4fce-be85-8dfbf626768d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.162799 Aug 31 07:05:29.469248 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 269/560] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:29 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:30.493893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:30.494765 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:30.506130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:30.506933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:30.507685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:30.508811 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:30.509559 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:30.510253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:30.645287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:30.653842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d0ea6511-ca09-475b-a9de-b5ed81e4a1df tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.166549 Aug 31 07:05:30.654413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 292/561] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:30 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:31.246517 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:31.248866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:31.256587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:31.257068 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:31.257499 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:31.258176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:31.258616 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:31.259080 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:31.339310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6d8ced1f-2f20-41b6-8383-bc90dc88848f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/action" status: 202 len: 0 microversion: 2.1 time: 0.096821 Aug 31 07:05:31.343124 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 270/562] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:05:31 2022] POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:05:31.348854 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:31.349462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:31.356348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:31.356814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:31.357241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:31.357927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:31.358370 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:31.358786 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:31.556546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:31.565435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4830d45c-4aec-41f1-9694-a515f44c1f43 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1752 microversion: 2.1 time: 0.220904 Aug 31 07:05:31.565989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 293/563] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:31 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:31.676649 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:31.677336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:31.683671 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:31.684141 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:31.684570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:31.685250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:31.685693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:31.686107 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:31.826985 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:31.835613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5b5dec15-c3e0-47f7-91da-287116927c93 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.163372 Aug 31 07:05:31.836178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 271/564] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:31 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:32.591238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:32.592249 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:32.600339 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:32.600827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:32.601261 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:32.601960 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:32.602409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:32.602827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:32.759630 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:32.768865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-db120ed1-f5a2-40f8-8cb8-001132b7ac08 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1752 microversion: 2.1 time: 0.184223 Aug 31 07:05:32.769437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 294/565] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:32 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:32.858634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:32.859243 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:32.866182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:32.866662 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:32.867131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:32.867817 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:32.868267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:32.868688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:33.018582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:33.027163 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4a6a905b-0ce9-4dc8-9514-cdb642dd9d41 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1733 microversion: 2.1 time: 0.172817 Aug 31 07:05:33.027737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 272/566] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:32 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:33.792721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:33.793513 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:33.802591 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:33.803256 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:33.803827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:33.804723 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:33.805293 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:33.805845 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:33.959332 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:33.968716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-39b1d638-a993-4af9-8583-48f8bd1baaf7 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1752 microversion: 2.1 time: 0.181865 Aug 31 07:05:33.969354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 295/567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:33 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:34.049874 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:34.050452 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:34.057143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.057623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.058055 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.058749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.059225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.059644 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.198197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:34.206043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-624af5fd-90db-4098-8554-81d9db92484c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1713 microversion: 2.1 time: 0.159881 Aug 31 07:05:34.206749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 273/568] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:34 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:34.325234 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:34.325757 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:34.331948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.332464 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.332893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.333589 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.334016 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.334429 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.417978 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] HTTP exception thrown: Cannot 'detach_volume' instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d while it is in vm_state rescued Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Request method failure captured: Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: DELETE /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments/8e596e93-ec30-4c6d-b072-42eecd2bc7d7 HTTP/1.1 Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwc73vfOJKsuo-lE0dkRXVMK2NY8gbtDnNYwTIseD9r9rdZF_JTTzb15NFSpIWLF9lhaSgQ5FLNKJ9e_C2MiVjXG6VZvk_NzU_EK_TGb378NDvuxSdhgk0R6mf1yu8GqR04SjBB6A9dhsxuE_iRZ0E1q4-SGrZiZqqFElHloC_NTpfA Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:05:34.419625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a83fcf85c5fc44e396c97573a73f675a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 8b9c07381f404ec39a06e01ff890da5e Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:05:34.421282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Cannot 'detach_volume' instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d while it is in vm_state rescued Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'server_id': 'da8ac19a-b609-4d5a-93ce-78a6abc0ee1d', 'id': '8e596e93-ec30-4c6d-b072-42eecd2bc7d7'} Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:05:34.422033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d while it is in vm_state rescued Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d while it is in vm_state rescued Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:34.423331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Returning 409 to user: Cannot 'detach_volume' instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d while it is in vm_state rescued {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:05:34.425398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8a651875-0377-4717-98cb-90d5d42b3a98 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "DELETE /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments/8e596e93-ec30-4c6d-b072-42eecd2bc7d7" status: 409 len: 152 microversion: 2.1 time: 0.100004 Aug 31 07:05:34.425398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 296/569] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:05:34 2022] DELETE /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments/8e596e93-ec30-4c6d-b072-42eecd2bc7d7 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 07:05:34.430615 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:34.431182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:34.437414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.437900 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.438338 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.439128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.439577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.440382 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.515049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-040f3e85-a3b1-40a1-a5c9-e87ce362e75d tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "POST /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/action" status: 202 len: 0 microversion: 2.1 time: 0.088145 Aug 31 07:05:34.518883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 274/570] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:05:34 2022] POST /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:05:34.524875 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:34.525529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:34.532422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.532904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.533334 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.534219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:34.534668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:34.535160 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:34.912979 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:34.921778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3745a281-9f7b-4f76-bb62-5bc4ef58bab2 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1721 microversion: 2.1 time: 0.400990 Aug 31 07:05:34.926438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 297/571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:34 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:05:34.993717 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:34.994403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:35.001083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:35.001566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:35.001994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:35.002692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:35.003169 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:35.003584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:35.221972 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:35.227710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:35.228317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:35.235592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dc06b6e3-986a-4dad-a364-59f8fb85a378 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.246218 Aug 31 07:05:35.235763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:35.236432 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:35.237116 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:35.238035 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:35.238469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:35.239065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:35.249901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 275/572] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:34 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:35.321434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lazy-loading 'services' on Instance uuid 3a860b25-77ef-4144-bbde-d2dae011247e {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:05:35.403231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c2594c49-f1dd-486d-a282-538f24b87862 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e/os-volume_attachments/952a8cf0-a77e-4703-9abb-a936e1d4f0c7" status: 202 len: 0 microversion: 2.1 time: 0.179921 Aug 31 07:05:35.403820 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 298/573] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:05:35 2022] DELETE /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e/os-volume_attachments/952a8cf0-a77e-4703-9abb-a936e1d4f0c7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:05:35.948269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:35.949242 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:35.958336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:35.958811 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:35.959275 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:35.959957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:35.960403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:35.960827 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:36.124210 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:36.134100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c1892a8f-3102-4613-969f-f11907ad2748 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1721 microversion: 2.1 time: 0.192423 Aug 31 07:05:36.134668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 276/574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:35 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:36.258881 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:36.259572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:36.266514 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:36.267027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:36.267452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:36.268270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:36.268780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:36.269198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:36.428795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:36.437350 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2d7a087b-a4d4-44f0-bded-b6512c593a24 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.183263 Aug 31 07:05:36.437947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 299/575] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:36 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:05:37.160442 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:37.161488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:37.173058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:37.173855 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:37.174613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:37.175518 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:37.175975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:37.176396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:37.312526 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:37.325368 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bdb297bf-21c3-4924-8024-0fb151e91eaf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1721 microversion: 2.1 time: 0.171636 Aug 31 07:05:37.326130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 277/576] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:37 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:37.459039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:37.459716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:37.466544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:37.467075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:37.467510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:37.468206 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:37.468658 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:37.469098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:37.615795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:37.624059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-112dbf81-15af-4196-b12e-9b894465d557 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.169168 Aug 31 07:05:37.624637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 300/577] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:37 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:38.348649 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:38.349251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:38.355890 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:38.356363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:38.356789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:38.357475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:38.357919 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:38.358334 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:38.491308 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:38.499948 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d8d265fd-f906-4ff4-aec6-1e869054bdc0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1727 microversion: 2.1 time: 0.155323 Aug 31 07:05:38.500523 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 278/578] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:38 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:38.520616 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:38.521150 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:38.527756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:38.528237 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:38.528673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:38.529352 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:38.529800 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:38.530224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:38.610110 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1d58a826-6f1c-40f5-b318-ed05da408ccd tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093421 Aug 31 07:05:38.610700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 301/579] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:05:38 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:38.644916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:38.645650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:38.652192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:38.652748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:38.653247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:38.654017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:38.654560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:38.655679 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:38.800369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:38.802777 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:38.809955 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-99863eb5-c095-496f-a712-0d70e346db8b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.168981 Aug 31 07:05:38.810534 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 279/580] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:38 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:39.506724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-5cca298e-f525-4272-a6e8-8c6a5a005a86 req-eb9664d2-d73e-4ded-876f-48a2f0736f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8ac19a-b609-4d5a-93ce-78a6abc0ee1d", "tag": "bd463e45-bc79-4baa-970d-739b70ba4761"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:39.525743 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-5cca298e-f525-4272-a6e8-8c6a5a005a86 req-eb9664d2-d73e-4ded-876f-48a2f0736f3d service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:39.527022 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-5cca298e-f525-4272-a6e8-8c6a5a005a86 req-eb9664d2-d73e-4ded-876f-48a2f0736f3d service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:39.527599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-5cca298e-f525-4272-a6e8-8c6a5a005a86 req-eb9664d2-d73e-4ded-876f-48a2f0736f3d service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:39.543590 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-5cca298e-f525-4272-a6e8-8c6a5a005a86 req-eb9664d2-d73e-4ded-876f-48a2f0736f3d service nova] Creating event network-changed:bd463e45-bc79-4baa-970d-739b70ba4761 for instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d on hv-cinder-85528 Aug 31 07:05:39.548447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-5cca298e-f525-4272-a6e8-8c6a5a005a86 req-eb9664d2-d73e-4ded-876f-48a2f0736f3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045420 Aug 31 07:05:39.549043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 302/581] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:39.723698 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:39.724257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:39.732252 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:39.732734 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:39.733162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:39.733863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:39.734312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:39.734731 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:39.764578 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:05:39.833426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:39.834099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:39.842091 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:39.842987 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:39.843643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:39.844555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:39.845151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:39.845791 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:39.886803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-823869b6-3be5-4238-9051-0a8f82b26d83 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 204 len: 0 microversion: 2.1 time: 0.167899 Aug 31 07:05:39.887496 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 280/582] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:05:39 2022] DELETE /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:05:39.897058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:39.897823 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:39.904087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:39.907334 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:39.908201 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:39.909002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:39.909632 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:39.910118 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:40.024880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:40.033845 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d4f343cb-e140-4bf2-acc2-979fb0fbab95 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.206260 Aug 31 07:05:40.034993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 303/583] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:39 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:40.063058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:40.071576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e7227534-123e-4d43-97c7-77f7b7a35018 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1513 microversion: 2.1 time: 0.179074 Aug 31 07:05:40.072342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 281/584] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:39 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:41.060187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:41.061253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:41.072443 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:41.073242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:41.073966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:41.075175 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:41.075922 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:41.076619 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:41.092964 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:41.093646 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:41.096230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:41.102342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:41.102923 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:41.103398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:41.104102 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:41.104536 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:41.104951 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:41.227782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:41.231405 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:41.236981 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-29b33a04-3e67-44dd-9e74-8127593af47f tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.183376 Aug 31 07:05:41.237599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 304/585] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:41 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:41.239739 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:41.247924 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9e3eb5eb-13d3-4c84-b1d6-c07c33458f96 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1513 microversion: 2.1 time: 0.158906 Aug 31 07:05:41.248572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 282/586] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:41 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:41.568743 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-509b32ef-5e1b-4b80-8daa-ae2310feca90 req-cdc5288f-cbca-4c9b-a52a-0e6dcf0fb64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8ac19a-b609-4d5a-93ce-78a6abc0ee1d", "tag": "bd463e45-bc79-4baa-970d-739b70ba4761"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:41.578665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-509b32ef-5e1b-4b80-8daa-ae2310feca90 req-cdc5288f-cbca-4c9b-a52a-0e6dcf0fb64b service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:41.579162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-509b32ef-5e1b-4b80-8daa-ae2310feca90 req-cdc5288f-cbca-4c9b-a52a-0e6dcf0fb64b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:41.579584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-509b32ef-5e1b-4b80-8daa-ae2310feca90 req-cdc5288f-cbca-4c9b-a52a-0e6dcf0fb64b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:41.591054 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-509b32ef-5e1b-4b80-8daa-ae2310feca90 req-cdc5288f-cbca-4c9b-a52a-0e6dcf0fb64b service nova] Creating event network-changed:bd463e45-bc79-4baa-970d-739b70ba4761 for instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d on hv-cinder-85528 Aug 31 07:05:41.596044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-509b32ef-5e1b-4b80-8daa-ae2310feca90 req-cdc5288f-cbca-4c9b-a52a-0e6dcf0fb64b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033021 Aug 31 07:05:41.596599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 305/587] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:42.258800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:42.259475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:42.266581 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:42.267136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:42.267571 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:42.268264 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:42.268724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:42.269143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:42.271930 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:42.272647 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:42.279148 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:42.279639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:42.280069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:42.280772 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:42.281230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:42.281641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:42.425536 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:42.434366 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-df635859-ecdb-41f5-8833-797e089c37b0 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1513 microversion: 2.1 time: 0.168346 Aug 31 07:05:42.435244 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 306/588] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:42 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:42.491833 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:42.500710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-fb51153d-e2ed-40b2-8fd7-daf6c19db5d0 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.245854 Aug 31 07:05:42.501629 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 283/589] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:42 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:43.456026 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:43.457055 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:43.464581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:43.466292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:43.467002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:43.467952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:43.468598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:43.469267 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:43.503652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:43.504452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:43.504888 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:43.505357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lazy-loading 'fault' on Instance uuid 3a860b25-77ef-4144-bbde-d2dae011247e {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:05:43.522305 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:43.522915 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:43.529947 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:43.530130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:43.530445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:43.531165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:43.531617 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:43.532039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:43.551716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317bddaf96694853b3e029b2d23af87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c80a72cf6844c3afd353461c55e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:43.559436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3031ffc2-f143-4547-b030-5228a5b5da7e tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 200 len: 1308 microversion: 2.1 time: 0.107277 Aug 31 07:05:43.560211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 307/590] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:43 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:05:43.610472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-f25deb97-4eec-4b29-9e01-ec8c41442d68 req-c9a65e2b-f321-46d3-9dde-1d31c5308b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a860b25-77ef-4144-bbde-d2dae011247e", "name": "network-vif-deleted", "tag": "cbae97a7-477d-467f-a117-4502e24cbd55"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:43.620431 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-f25deb97-4eec-4b29-9e01-ec8c41442d68 req-c9a65e2b-f321-46d3-9dde-1d31c5308b9f service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:43.620997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-f25deb97-4eec-4b29-9e01-ec8c41442d68 req-c9a65e2b-f321-46d3-9dde-1d31c5308b9f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:43.621493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-f25deb97-4eec-4b29-9e01-ec8c41442d68 req-c9a65e2b-f321-46d3-9dde-1d31c5308b9f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:43.633019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-f25deb97-4eec-4b29-9e01-ec8c41442d68 req-c9a65e2b-f321-46d3-9dde-1d31c5308b9f service nova] Creating event network-vif-deleted:cbae97a7-477d-467f-a117-4502e24cbd55 for instance 3a860b25-77ef-4144-bbde-d2dae011247e on hv-cinder-85528 Aug 31 07:05:43.638165 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-f25deb97-4eec-4b29-9e01-ec8c41442d68 req-c9a65e2b-f321-46d3-9dde-1d31c5308b9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031420 Aug 31 07:05:43.638766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 308/591] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:43.749193 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:43.757838 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cd8b86c0-64c0-4dd2-bc8e-21fb4e63abd8 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.240189 Aug 31 07:05:43.758401 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 284/592] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:43 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:05:44.582469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:44.583160 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] [instance: 3a860b25-77ef-4144-bbde-d2dae011247e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:44.589624 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:44.590096 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:44.590527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:44.591247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:44.591666 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:44.592106 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:44.605673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] HTTP exception thrown: Instance 3a860b25-77ef-4144-bbde-d2dae011247e could not be found. Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Request method failure captured: Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e HTTP/1.1 Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwetldNL96vimD9BohFQtCS7a519lMbVD8YSp3Qxq9BWrqBBZNfLsPdm7HAKwtWzehBs7859f_GWCCKC50uMYizXC2knRqRH0q9GC-VJhkbjM8FwG6rS1E_VFE9I9nSvkNuRZOPpn0BoqGIxi6LjCqQW0O3OEj9HpVkJrPd3YVyTXNk Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: f1c80a72cf6844c3afd353461c55e580 Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1594799693 Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:05:44.607354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1c80a72cf6844c3afd353461c55e580"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1c80a72cf6844c3afd353461c55e580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1c80a72cf6844c3afd353461c55e580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1c80a72cf6844c3afd353461c55e580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesSnapshotTestJSON-1594799693 Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: f1c80a72cf6844c3afd353461c55e580 Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1594799693 Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesSnapshotTestJSON-1594799693-project Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 317bddaf96694853b3e029b2d23af87f Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesSnapshotTestJSON-1594799693-project Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 3a860b25-77ef-4144-bbde-d2dae011247e could not be found. Aug 31 07:05:44.608834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '3a860b25-77ef-4144-bbde-d2dae011247e'} Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a860b25-77ef-4144-bbde-d2dae011247e could not be found. Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:05:44.609852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a860b25-77ef-4144-bbde-d2dae011247e could not be found. Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a860b25-77ef-4144-bbde-d2dae011247e could not be found. Aug 31 07:05:44.611308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:05:44.612569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] Returning 404 to user: Instance 3a860b25-77ef-4144-bbde-d2dae011247e could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:05:44.612569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-df03927a-09a9-4733-af08-9cb1d0208cb7 tempest-VolumesSnapshotTestJSON-1594799693 tempest-VolumesSnapshotTestJSON-1594799693-project] 10.222.0.42 "GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e" status: 404 len: 111 microversion: 2.1 time: 0.031341 Aug 31 07:05:44.612569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 309/593] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:44 2022] GET /compute/v2.1/servers/3a860b25-77ef-4144-bbde-d2dae011247e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:05:44.779090 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:44.779927 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:44.788647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:44.789122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:44.790151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:44.791064 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:44.791646 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:44.792254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:44.959080 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:44.967381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1f39e176-b248-4f7f-af10-f3ac14303d47 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.192793 Aug 31 07:05:44.967944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 285/594] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:44 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:45.988212 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:45.988816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:45.995376 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:45.995852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:45.996288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:45.996964 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:45.997492 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:45.997807 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:46.159157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:46.168403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e4a3c267-4d5d-4fc8-879e-fa70f05517e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.183967 Aug 31 07:05:46.168904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 310/595] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:45 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:47.191082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:47.191656 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:47.199039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:47.199566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:47.200022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:47.200725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:47.201180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:47.201608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:47.351312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:47.359786 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-da3ef208-341d-4a4a-b8f1-83aa6bdc0db3 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.173018 Aug 31 07:05:47.360355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 286/596] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:47 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:48.235831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:48.236735 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:48.245976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.246915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.247833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.249254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.249699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.250109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.284375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c0dafbd0-8d8b-4cf9-8689-cdefd9ec3504 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments/9f90258c-432f-4688-a1eb-f42c7ce6af60" status: 200 len: 194 microversion: 2.20 time: 0.055207 Aug 31 07:05:48.284958 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 311/597] 10.222.0.42 () {60 vars in 1454 bytes} [Wed Aug 31 07:05:48 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments/9f90258c-432f-4688-a1eb-f42c7ce6af60 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:05:48.361303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:48.361818 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:48.368810 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.369291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.369725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.370414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.370891 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.371309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.380819 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:48.381452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:48.388101 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.388808 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.389251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.389944 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.390391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.390809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.501599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lazy-loading 'services' on Instance uuid 511f1298-6885-4659-86c4-2bb83fa7803b {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:05:48.538242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:48.547437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ed50af8d-a56e-455f-b35c-3e219f7c04a1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.170395 Aug 31 07:05:48.548001 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 312/598] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:48 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:48.622617 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8b923a5b-f65f-4af6-af4d-2263d914d314 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments/9f90258c-432f-4688-a1eb-f42c7ce6af60" status: 202 len: 0 microversion: 2.20 time: 0.265185 Aug 31 07:05:48.623357 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 287/599] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Aug 31 07:05:48 2022] DELETE /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments/9f90258c-432f-4688-a1eb-f42c7ce6af60 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:05:48.632923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:48.635086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:48.641839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.642324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.642904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.643760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:48.644446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:48.644850 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:48.677803 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d6cbff9a-1c74-42a5-b3b3-60f58ba63f60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049708 Aug 31 07:05:48.678323 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 313/600] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 07:05:48 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:05:49.571901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:49.572541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:49.579739 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:49.580265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:49.580738 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:49.581448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:49.581952 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:49.582423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:49.691235 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:49.693381 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:49.700467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:49.700953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:49.701386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:49.702088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:49.702539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:49.702997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:49.734573 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-49c9bc88-1fd7-4185-a4b8-87f0e0ce7d9c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047347 Aug 31 07:05:49.735182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 314/601] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 07:05:49 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:05:49.735335 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:49.743814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f9b3d7e4-f4be-4105-b06e-b80a6aacc5d4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.176953 Aug 31 07:05:49.744339 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 288/602] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:49 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:50.748629 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:50.750692 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:50.757804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.758288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.758759 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:50.759471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.759920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.760343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:50.764131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:50.764817 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:50.771843 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.772342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.772760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:50.773609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.774047 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.774512 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:50.790771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5b5482c6-c0e5-4ff7-a726-4a5852217761 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046305 Aug 31 07:05:50.791372 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 315/603] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 07:05:50 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:50.854628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:50.855263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:50.861446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.861923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.862353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:50.863076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.863502 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.863936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:50.889569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:05:50.922444 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:50.931286 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7ffee4b0-3dd1-40a5-a3e5-01aa6c6a0583 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.171031 Aug 31 07:05:50.931902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 289/604] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:50 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:50.976988 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d44c855f-b30e-47a6-91e1-b8d8e5abc7f9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 204 len: 0 microversion: 2.20 time: 0.126140 Aug 31 07:05:50.977583 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 316/605] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 07:05:50 2022] DELETE /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 07:05:50.986604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:50.987251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:50.993755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.994247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.994679 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:50.995725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:50.996253 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:50.996678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:51.129100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:51.137453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:51.138918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:51.140071 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ae6f0cee-3609-4635-89c2-694fdb93f002 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.157406 Aug 31 07:05:51.140627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 290/606] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:50 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:05:51.957930 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:51.958916 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:51.967058 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:51.967541 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:51.967969 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:51.968646 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:51.969091 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:51.969501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:52.114371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:52.123082 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2b9835de-45c1-48b9-9fe5-b1a90555521b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.172347 Aug 31 07:05:52.123625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 317/607] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:51 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:52.165185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:52.165966 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:52.175127 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:52.175752 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:52.176437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:52.177405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:52.177855 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:52.178409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:52.322033 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:52.331119 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:52.332606 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:52.333771 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4e82e823-c342-411a-b07e-166d7b44af9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.174531 Aug 31 07:05:52.334304 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 291/608] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:52 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:05:53.015450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:53.015961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:53.033213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.033695 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.034230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.034939 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.035412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.035948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.075464 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ce4bbf8c-ef41-41a0-a8ec-a64678f02268 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723/ips" status: 200 len: 150 microversion: 2.1 time: 0.063890 Aug 31 07:05:53.083318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 318/609] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:05:53 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723/ips => generated 150 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:53.088769 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf686852-a414-43d5-9bd9-097d3142d6a9"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:53.091678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:53.098426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.098996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.099685 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.100496 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.101010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.101746 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.144277 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:53.144937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:53.163566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.164186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.164634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.165966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.166424 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.166873 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.215021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Invalid volume: volume cf686852-a414-43d5-9bd9-097d3142d6a9 is already attached to instances: c90e4773-c53c-4ed4-b224-f6763afc33d9 Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: POST /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723/os-volume_attachments HTTP/1.1 Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 74 Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:05:53.218162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {"volumeAttachment": {"volumeId": "cf686852-a414-43d5-9bd9-097d3142d6a9"}} Aug 31 07:05:53.220307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Invalid volume: volume cf686852-a414-43d5-9bd9-097d3142d6a9 is already attached to instances: c90e4773-c53c-4ed4-b224-f6763afc33d9 Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'server_id': '336cfa5e-6e07-45f0-af84-07847284d723', 'body': {'volumeAttachment': {'volumeId': 'cf686852-a414-43d5-9bd9-097d3142d6a9'}}} Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf686852-a414-43d5-9bd9-097d3142d6a9 is already attached to instances: c90e4773-c53c-4ed4-b224-f6763afc33d9 Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:05:53.221498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf686852-a414-43d5-9bd9-097d3142d6a9 is already attached to instances: c90e4773-c53c-4ed4-b224-f6763afc33d9 Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:05:53.222749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf686852-a414-43d5-9bd9-097d3142d6a9 is already attached to instances: c90e4773-c53c-4ed4-b224-f6763afc33d9 Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 400 to user: Invalid volume: volume cf686852-a414-43d5-9bd9-097d3142d6a9 is already attached to instances: c90e4773-c53c-4ed4-b224-f6763afc33d9 {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-213064ed-c2e7-46de-aa70-88f2baee04af tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134939 Aug 31 07:05:53.224106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 292/610] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:05:53 2022] POST /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:05:53.229629 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:53.230644 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:53.239027 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.239806 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.240605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.241575 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.242409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.243084 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.277915 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:05:53.293858 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:53.339080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:53.348911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8bd01cdf-9a33-4275-9b7d-2cb5fb31c918 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.208629 Aug 31 07:05:53.359615 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 319/611] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:53 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:53.366747 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:53.367450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:53.368678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5ac07713-ba89-4eba-b3e3-6ee45cacdc5c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 204 len: 0 microversion: 2.1 time: 0.142512 Aug 31 07:05:53.369745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 293/612] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:05:53 2022] DELETE /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:05:53.378283 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.378741 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.379253 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.380121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.380614 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:53.380807 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.381440 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.381870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:53.389298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.389931 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.390460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.391399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:53.391945 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:53.392434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:53.522412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:53.531508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:53.532989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:53.534144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-db28f4fb-3a9a-46fb-9697-11afb43f9073 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1725 microversion: 2.20 time: 0.171699 Aug 31 07:05:53.534684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 320/613] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:53 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:05:53.624932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:53.632927 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2545fea0-2a52-43ac-88e3-6658e1a5c285 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1682 microversion: 2.1 time: 0.258749 Aug 31 07:05:53.633590 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 294/614] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:53 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1682 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:54.324665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-1ff08abb-5ba7-4b68-bf93-21c1a75c516d req-fe8c45f7-e337-465a-b4b6-3e04e89bc904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511f1298-6885-4659-86c4-2bb83fa7803b", "name": "network-vif-deleted", "tag": "f1143e84-14e6-46df-9c89-a9a60f4e8a19"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:54.336692 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-1ff08abb-5ba7-4b68-bf93-21c1a75c516d req-fe8c45f7-e337-465a-b4b6-3e04e89bc904 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:54.337171 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-1ff08abb-5ba7-4b68-bf93-21c1a75c516d req-fe8c45f7-e337-465a-b4b6-3e04e89bc904 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:54.338651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-1ff08abb-5ba7-4b68-bf93-21c1a75c516d req-fe8c45f7-e337-465a-b4b6-3e04e89bc904 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:54.352696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-1ff08abb-5ba7-4b68-bf93-21c1a75c516d req-fe8c45f7-e337-465a-b4b6-3e04e89bc904 service nova] Creating event network-vif-deleted:f1143e84-14e6-46df-9c89-a9a60f4e8a19 for instance 511f1298-6885-4659-86c4-2bb83fa7803b on hv-cinder-85528 Aug 31 07:05:54.358450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-1ff08abb-5ba7-4b68-bf93-21c1a75c516d req-fe8c45f7-e337-465a-b4b6-3e04e89bc904 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037896 Aug 31 07:05:54.359677 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 321/615] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:05:54.374530 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:54.375138 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:54.384621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:54.385101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:54.385527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:54.386478 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:54.387136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:54.387704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:54.562355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:54.563474 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:54.568033 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:54.570561 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:54.571263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:54.571843 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:54.572974 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:54.573789 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:54.574262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:54.579236 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d974ca3e-80a4-4a08-91a0-501b796c3d92 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.209590 Aug 31 07:05:54.580323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 295/616] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:54 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:54.596545 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:54.643465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:54.655166 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:54.656284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:54.656606 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:54.656884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:54.657915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a08e8563-33fc-428e-8cc8-2589b8073077 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1657 microversion: 2.20 time: 0.101508 Aug 31 07:05:54.658656 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 322/617] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:54 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1657 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:05:54.664605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:54.665453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:54.665882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:54.666788 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:54.667459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:54.668024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:54.808636 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:54.816682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-fd5ad25f-df59-40e3-9c5e-d2c38307d544 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1682 microversion: 2.1 time: 0.165039 Aug 31 07:05:54.817500 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 296/618] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:54 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:55.600774 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:55.601360 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:55.608453 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:55.608940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:55.609378 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:55.610074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:55.610520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:55.610972 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:55.680931 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:55.681543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:55.688886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:55.689577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:55.690579 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:55.691026 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:55.691528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:55.692021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:55.758115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:55.766939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:55.768264 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:55.769424 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d6a6aad4-c993-428c-b81a-f98f3768aca7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1657 microversion: 2.20 time: 0.092501 Aug 31 07:05:55.769699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:55.769976 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 297/619] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:55 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:05:55.778714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-540e5b7f-b1b5-438b-94c9-bf327a5b2c4a tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.181962 Aug 31 07:05:55.779272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 323/620] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:55 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:55.839408 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:55.839986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:55.846688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:55.847236 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:55.847667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:55.848393 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:55.848841 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:55.849264 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:55.984816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:55.993374 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3a5281ef-168a-4ff1-8b47-47782c609be5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1682 microversion: 2.1 time: 0.157866 Aug 31 07:05:55.993954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 298/621] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:55 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:56.795697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:56.796330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:56.800076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:56.800680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:56.803575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:56.804066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:56.804495 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:56.805186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:56.805663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:56.806107 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:56.806860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:56.807349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:56.807784 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:56.808501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:56.808996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:56.809417 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:56.869194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:56.878761 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:56.880282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:56.881635 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e3bcb6cd-0db2-4a7a-9ec7-e08db73aaeb2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1657 microversion: 2.20 time: 0.090912 Aug 31 07:05:56.882394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 324/622] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:56 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:05:56.965851 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:56.974380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b8130981-0c36-4ba8-8768-75c79f63b58e tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.177945 Aug 31 07:05:56.974954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 299/623] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:56 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:57.014896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:57.015503 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:57.021656 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:57.022165 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:57.022592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:57.023303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:57.023745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:57.024157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:57.155012 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:57.163399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-83a168fa-8545-4971-ace8-b7950b60b2d5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1682 microversion: 2.1 time: 0.152552 Aug 31 07:05:57.163961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 325/624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:57 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:57.905453 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:57.906074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:57.913093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:57.913545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:57.913977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:57.914725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:57.915565 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:57.915978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:57.978271 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:57.987744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:57.989172 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:57.990392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-22be361c-9712-4683-8b48-c801d4621565 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1366 microversion: 2.20 time: 0.089052 Aug 31 07:05:57.990996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 300/625] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:57 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:05:57.995917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:57.996679 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:58.003447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:58.003929 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:58.004358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:58.005072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:58.005520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:58.005936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:58.156241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:58.169669 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4c708a51-5225-41c2-813c-74f834a8e742 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1757 microversion: 2.1 time: 0.177376 Aug 31 07:05:58.170437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 326/626] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:57 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:05:58.185417 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:58.186027 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:58.193019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:58.193532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:58.193964 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:58.194675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:58.195164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:58.195604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:58.343940 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:58.352325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f4753504-46c1-492d-8bd0-7ae0aad0fbe4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1682 microversion: 2.1 time: 0.170982 Aug 31 07:05:58.352905 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 301/627] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:58 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:59.013329 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:59.014890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:59.019051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:05:59.025202 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.026211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.026680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.028136 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.028676 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.029077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.071439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.071911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.072332 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.072769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lazy-loading 'fault' on Instance uuid 511f1298-6885-4659-86c4-2bb83fa7803b {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:05:59.116131 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:59.125598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:59.127055 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:59.128215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-02bf0b43-989a-4945-8636-d0d97cc2cbd5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 200 len: 1371 microversion: 2.20 time: 0.119386 Aug 31 07:05:59.128965 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 327/628] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:05:59 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 1371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:05:59.197858 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:59.198477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:59.206252 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.206732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.207196 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.207898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.208341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.208760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.374472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:05:59.375125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:05:59.382047 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.382721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.383396 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.384376 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.385185 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.385760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.457979 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:59.467542 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ec214ae3-cbff-4264-b7df-1b0c45fe4594 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1614 microversion: 2.1 time: 0.097008 Aug 31 07:05:59.468130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 328/629] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:59 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:59.517765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:05:59.536846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ec97adf5-8b87-4458-87b6-7123f91e07e5 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1760 microversion: 2.1 time: 0.342916 Aug 31 07:05:59.537431 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 302/630] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:05:59 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1760 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:05:59.717884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-0bc17234-bbf7-4ed3-8b12-3a2f1c8c599e req-0283ce2e-b6a7-49a3-a8b8-acbc8249baba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336cfa5e-6e07-45f0-af84-07847284d723", "name": "network-vif-deleted", "tag": "6a3a3984-9c5f-43b0-817c-b3924c1cd829"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:05:59.729038 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0bc17234-bbf7-4ed3-8b12-3a2f1c8c599e req-0283ce2e-b6a7-49a3-a8b8-acbc8249baba service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:05:59.729528 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0bc17234-bbf7-4ed3-8b12-3a2f1c8c599e req-0283ce2e-b6a7-49a3-a8b8-acbc8249baba service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:05:59.730300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0bc17234-bbf7-4ed3-8b12-3a2f1c8c599e req-0283ce2e-b6a7-49a3-a8b8-acbc8249baba service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:05:59.743003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-0bc17234-bbf7-4ed3-8b12-3a2f1c8c599e req-0283ce2e-b6a7-49a3-a8b8-acbc8249baba service nova] Creating event network-vif-deleted:6a3a3984-9c5f-43b0-817c-b3924c1cd829 for instance 336cfa5e-6e07-45f0-af84-07847284d723 on hv-cinder-85528 Aug 31 07:05:59.748812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-0bc17234-bbf7-4ed3-8b12-3a2f1c8c599e req-0283ce2e-b6a7-49a3-a8b8-acbc8249baba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034653 Aug 31 07:05:59.754111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 329/631] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:00.150341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:00.154437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:00.160858 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:00.161422 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:00.161781 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:00.162639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:00.163258 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:00.164160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:00.181989 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] HTTP exception thrown: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Request method failure captured: Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b HTTP/1.1 Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc6A-WEVjXlN8JksvmpoU2SoaI89pkTkseiX91wiNBBQyjGsvNQLxIb7PKB6GyiPlFodm_59ZETMXDT-1FRhaKBkh23DKc1AcFP5xSb6Kgkh_KCrKOVmw_2NVoPhgCuYyL7njm4tUJMTBqykRE8a5C0I8VU4F7sPrtqesUJfm-Hh3k Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:06:00.184651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b7d83c7e3bc42c0b85b360dd55bbd5a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: c7232639661c42f59e4403c4819987d8 Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:06:00.186037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '511f1298-6885-4659-86c4-2bb83fa7803b'} Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:00.186979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:06:00.188266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:00.192219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Returning 404 to user: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:00.192219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6cb7b7ec-eb1d-4e2c-a820-5d4cd6164f6e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 404 len: 111 microversion: 2.20 time: 0.039797 Aug 31 07:06:00.192219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 303/632] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:00 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:06:00.195800 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f82e6d95-076e-4c30-839b-4028c96e2de0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '.version_select at 0x7ff9c06370d0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:00.219568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f82e6d95-076e-4c30-839b-4028c96e2de0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812395627" status: 204 len: 0 microversion: 2.20 time: 0.027852 Aug 31 07:06:00.220160 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 330/633] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Aug 31 07:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812395627 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 07:06:00.490578 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:00.491611 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:00.504142 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:00.504888 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:00.505676 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:00.506583 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:00.507334 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:00.508030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:00.546699 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:00.547446 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:00.547866 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:00.548609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lazy-loading 'fault' on Instance uuid 336cfa5e-6e07-45f0-af84-07847284d723 {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:00.619151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:00.627423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-080602f5-9a6a-4f43-a4a6-21098397fabf tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 200 len: 1331 microversion: 2.1 time: 0.141621 Aug 31 07:06:00.628635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 304/634] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:00 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:00.929244 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1a365d5c-ba64-4ccd-b73f-0e9cedc80236 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'create', calling method: .version_select at 0x7ff9c05aeb80>, body: {"keypair": {"name": "tempest-keypair-654564149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDtF88vgpkKzctFC0MRfskm8z51IlZUWfFhHtY3dg5t6aqgORvFZVBspL4wxOh/snXJFiUMZRLfUXaqF86WB2VfUriAOl983F9K+KE3uFfXPNduIvGs9MDrrUjdeJQysA=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:00.945934 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-1a365d5c-ba64-4ccd-b73f-0e9cedc80236 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:06:00.949940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-1a365d5c-ba64-4ccd-b73f-0e9cedc80236 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for user c7232639661c42f59e4403c4819987d8 and project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:06:00.973967 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1a365d5c-ba64-4ccd-b73f-0e9cedc80236 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049067 Aug 31 07:06:00.974549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 331/635] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Aug 31 07:06:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 07:06:01.650292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:01.650967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:01.657940 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:01.658419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:01.658861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:01.659573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:01.660014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:01.660434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:01.674515 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 HTTP/1.1 Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:06:01.676083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:06:01.677582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '336cfa5e-6e07-45f0-af84-07847284d723'} Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:01.678501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:06:01.679918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:01.681149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:01.681149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e1391156-83e1-4694-acf9-4cb928997dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 404 len: 111 microversion: 2.1 time: 0.031602 Aug 31 07:06:01.681721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 305/636] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:01 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:06:01.686763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-22d111a6-40d3-48ca-8c24-e0f150483bfa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '.version_select at 0x7ff9c06515e0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:01.707364 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-22d111a6-40d3-48ca-8c24-e0f150483bfa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523078035" status: 202 len: 0 microversion: 2.1 time: 0.024619 Aug 31 07:06:01.708010 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 332/637] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 31 07:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523078035 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:06:02.219716 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2061448910", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a30bcd85-0236-494d-bfd0-29b505e42da4"}], "security_groups": [{"name": "tempest-securitygroup--545428038"}], "key_name": "tempest-keypair-654564149", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:02.373659 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] validate_networks() for [('a30bcd85-0236-494d-bfd0-29b505e42da4', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:06:02.441652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:02.442272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:02.449507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:02.449507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:02.450040 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:02.450592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:02.451220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:02.451834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:02.543416 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lazy-loading 'services' on Instance uuid c90e4773-c53c-4ed4-b224-f6763afc33d9 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:02.616882 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-9e12e28c-7c89-4c7e-a5dd-1409e2a61113 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments/cf686852-a414-43d5-9bd9-097d3142d6a9" status: 202 len: 0 microversion: 2.1 time: 0.179244 Aug 31 07:06:02.617527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 333/638] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:06:02 2022] DELETE /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments/cf686852-a414-43d5-9bd9-097d3142d6a9 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 07:06:02.626282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:02.628534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:02.635824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:02.636498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:02.636976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:02.637668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:02.638109 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:02.638506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:02.671219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5abbe7f7-2745-4388-8bce-de1aea54f5a9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048841 Aug 31 07:06:02.672013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 334/639] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:06:02 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:06:02.779317 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:06:02.779807 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:06:02.780328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:06:02.780938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:06:02.781380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:06:02.793461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:02.794045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:02.794609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:02.795359 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:02.795812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:02.796270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:02.813562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:06:02.818004 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Getting quotas for user c7232639661c42f59e4403c4819987d8 and project 3b7d83c7e3bc42c0b85b360dd55bbd5a. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:06:02.831835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:06:02.834137 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:06:02.882615 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-241161dd-8dee-40d6-9129-00b2fb2a15bd tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.667204 Aug 31 07:06:02.883195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 306/640] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 31 07:06:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 07:06:02.894515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6c6aa512-b575-4d33-9e02-4394b841290b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:02.895138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6c6aa512-b575-4d33-9e02-4394b841290b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:02.950871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6c6aa512-b575-4d33-9e02-4394b841290b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:02.958816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6c6aa512-b575-4d33-9e02-4394b841290b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:02.960295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6c6aa512-b575-4d33-9e02-4394b841290b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:02.961413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6c6aa512-b575-4d33-9e02-4394b841290b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1281 microversion: 2.20 time: 0.070833 Aug 31 07:06:02.961971 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 335/641] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:02 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:06:03.686351 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:03.689557 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:03.706475 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.707240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.707824 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:03.708808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.709286 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.709898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:03.746502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-94e8f119-4083-4af7-839a-83cad1093c50 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066235 Aug 31 07:06:03.747433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 307/642] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:06:03 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:06:03.816211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:03.817104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:03.828592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.829184 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.829628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:03.830348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.830802 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.831262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:03.867318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:06:03.958714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-df70b2af-9cb3-449f-8a22-41d114851355 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 204 len: 0 microversion: 2.1 time: 0.147309 Aug 31 07:06:03.959388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 336/643] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:06:03 2022] DELETE /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:06:03.967720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:03.968324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:03.974533 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.975093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.975509 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:03.976190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.976619 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.977037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:03.984027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:03.984744 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:03.990926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.991416 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.991847 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:03.992615 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:03.993126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:03.993507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:04.059600 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:04.068329 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:04.070135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:04.071111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0a2904b7-ca78-4dfd-9022-86ca38661c60 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1333 microversion: 2.20 time: 0.091460 Aug 31 07:06:04.071647 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 337/644] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:03 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:04.114168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:04.122995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-768b5365-ef35-4065-b2f9-0de927094606 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1681 microversion: 2.1 time: 0.159223 Aug 31 07:06:04.123569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 308/645] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:03 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:05.102121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:05.103119 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:05.111161 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:05.111646 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:05.112079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:05.112778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:05.113227 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:05.113648 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:05.144911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:05.145585 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:05.152141 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:05.152712 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:05.153109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:05.154111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:05.154543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:05.154993 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:05.178377 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:05.187434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:05.190456 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:05.191800 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-207e2aea-efc9-4c23-85b0-3c135a7e3245 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1341 microversion: 2.20 time: 0.098989 Aug 31 07:06:05.193009 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 338/646] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:05 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1341 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:05.289037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:05.297430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-287ddae8-4fd4-40e8-8bba-e75e331bf2cb tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1681 microversion: 2.1 time: 0.156363 Aug 31 07:06:05.298023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 309/647] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:05 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:06.219026 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:06.219808 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:06.228450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:06.228938 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:06.229554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:06.230442 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:06.231063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:06.231889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:06.305737 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:06.315123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:06.316574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:06.317982 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b3cf7d39-c331-467f-aec5-64b3967499ed tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1339 microversion: 2.20 time: 0.103676 Aug 31 07:06:06.318547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 339/648] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:06 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:06.320115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:06.320728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:06.328066 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:06.328565 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:06.329005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:06.329776 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:06.330293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:06.330716 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:06.701330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:06.703737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:06.710759 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2d86d811-4780-47bd-b001-9522df136715 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1681 microversion: 2.1 time: 0.395006 Aug 31 07:06:06.711589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 310/649] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:06 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1681 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:07.342149 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:07.342746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:07.350684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:07.351223 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:07.351661 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:07.355551 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:07.356978 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:07.357520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:07.533782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:07.545010 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:07.546506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:07.548071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-372bc86f-5a6c-4f8d-8016-340fd87f912e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.210666 Aug 31 07:06:07.549391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 340/650] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:07 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:07.733468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:07.734139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:07.742438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:07.742934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:07.743363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:07.744054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:07.744532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:07.744945 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:07.832190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:07.840477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6e5dd57a-3a8b-4fc9-a582-ebf1d33bef7f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1613 microversion: 2.1 time: 0.110659 Aug 31 07:06:07.841324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 311/651] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:07 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:07.966289 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-2c67def9-d0b1-4716-bfcf-37f8e2116a22 req-505da41a-738c-4b54-abec-64431d31ae1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90e4773-c53c-4ed4-b224-f6763afc33d9", "name": "network-vif-deleted", "tag": "f53976a2-25d6-4a1c-9f42-fe424e928a99"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:07.979984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2c67def9-d0b1-4716-bfcf-37f8e2116a22 req-505da41a-738c-4b54-abec-64431d31ae1b service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:07.981516 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2c67def9-d0b1-4716-bfcf-37f8e2116a22 req-505da41a-738c-4b54-abec-64431d31ae1b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:07.982119 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2c67def9-d0b1-4716-bfcf-37f8e2116a22 req-505da41a-738c-4b54-abec-64431d31ae1b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:07.988029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:08.000190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-2c67def9-d0b1-4716-bfcf-37f8e2116a22 req-505da41a-738c-4b54-abec-64431d31ae1b service nova] Creating event network-vif-deleted:f53976a2-25d6-4a1c-9f42-fe424e928a99 for instance c90e4773-c53c-4ed4-b224-f6763afc33d9 on hv-cinder-85528 Aug 31 07:06:08.006977 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-2c67def9-d0b1-4716-bfcf-37f8e2116a22 req-505da41a-738c-4b54-abec-64431d31ae1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044605 Aug 31 07:06:08.007937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 341/652] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:08.576027 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:08.576623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:08.582835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:08.583312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:08.583949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:08.584910 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:08.585362 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:08.585762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:08.737609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:08.747230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:08.748938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:08.750056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5243ba36-f030-42cf-9889-5a96527f788e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.178156 Aug 31 07:06:08.763403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 312/653] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:08 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:08.863031 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:08.863706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:08.872997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:08.873632 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:08.874247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:08.875178 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:08.875624 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:08.876016 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:08.914753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:08.915841 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:08.916417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:08.917007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lazy-loading 'fault' on Instance uuid c90e4773-c53c-4ed4-b224-f6763afc33d9 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:09.077999 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:09.085912 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c47375a2-e076-4c9b-82af-ed4cfb2e88b1 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 200 len: 1331 microversion: 2.1 time: 0.227712 Aug 31 07:06:09.105696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 342/654] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:08 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 1331 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:09.772150 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:09.772737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:09.780216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:09.780729 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:09.781164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:09.781891 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:09.782342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:09.782766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:09.927175 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:09.936312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:09.937742 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:09.938873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d09d548e-a770-4050-833b-d989e6a2e874 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.170744 Aug 31 07:06:09.939440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 313/655] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:09 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:10.025162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-0ff29bab-e8d2-4e6f-82be-c31d1997f07d req-b9164a26-f235-42ad-94f4-61c69bf84cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4b2fea-9e69-462c-94b4-8f6757d17252", "tag": "32f136bd-488a-4bb2-bd5b-e40227ca99a7"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:10.035738 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0ff29bab-e8d2-4e6f-82be-c31d1997f07d req-b9164a26-f235-42ad-94f4-61c69bf84cdf service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:10.036211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0ff29bab-e8d2-4e6f-82be-c31d1997f07d req-b9164a26-f235-42ad-94f4-61c69bf84cdf service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:10.036642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0ff29bab-e8d2-4e6f-82be-c31d1997f07d req-b9164a26-f235-42ad-94f4-61c69bf84cdf service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:10.048707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-0ff29bab-e8d2-4e6f-82be-c31d1997f07d req-b9164a26-f235-42ad-94f4-61c69bf84cdf service nova] Creating event network-changed:32f136bd-488a-4bb2-bd5b-e40227ca99a7 for instance bf4b2fea-9e69-462c-94b4-8f6757d17252 on hv-cinder-85528 Aug 31 07:06:10.053704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-0ff29bab-e8d2-4e6f-82be-c31d1997f07d req-b9164a26-f235-42ad-94f4-61c69bf84cdf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032267 Aug 31 07:06:10.054278 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 343/656] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:10.111220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:10.112460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:10.122333 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:10.122825 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:10.123301 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:10.124000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:10.124471 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:10.124903 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:10.138607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 HTTP/1.1 Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:06:10.140270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:06:10.141750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'c90e4773-c53c-4ed4-b224-f6763afc33d9'} Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:10.142560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:06:10.144072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:10.145352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:10.145352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-58f62b6d-32b6-4a2c-8d19-801c3d16d7db tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 404 len: 111 microversion: 2.1 time: 0.037062 Aug 31 07:06:10.145352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 314/657] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:10 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:06:10.151471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-be9794ec-ad76-40ca-a0af-a70158a80b1a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '.version_select at 0x7ff9c0651af0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:10.173414 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-be9794ec-ad76-40ca-a0af-a70158a80b1a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-403923971" status: 202 len: 0 microversion: 2.1 time: 0.026251 Aug 31 07:06:10.173970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 344/658] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 31 07:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-403923971 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:06:10.961258 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:10.961885 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:10.968874 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:10.969438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:10.969868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:10.970563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:10.971075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:10.971472 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:11.156281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a44b9aa5-6b60-4a34-b3db-d198739628a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: .version_select at 0x7ff9c05b8790>, body: {"keypair": {"name": "tempest-keypair-174374420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaW5H3sZ216pOjBZNI+qMtDuOj936QcAjpcrYP8jRq5FmBXRX2SMWJK4r+q4XV4g+DkPmZCKKH2Q6xOLHa5Uak6xxeTTRBm0BxYi+PL3oB80YkjM+kPD7Tf8YpuYZO88w=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:11.172623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-a44b9aa5-6b60-4a34-b3db-d198739628a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:06:11.176473 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-a44b9aa5-6b60-4a34-b3db-d198739628a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:06:11.204359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a44b9aa5-6b60-4a34-b3db-d198739628a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052611 Aug 31 07:06:11.205362 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 345/659] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:06:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:06:11.361090 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:11.369568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:11.371067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:11.372154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-157bd99d-8ae2-4f0c-8e36-e5e611d5cfaa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.414917 Aug 31 07:06:11.372710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 315/660] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:10 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:12.396678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:12.397990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:12.404546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:12.405035 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:12.405467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:12.406164 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:12.406614 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:12.407079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:12.574952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:12.583505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:12.584950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:12.586068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ae045780-0351-4141-acd4-6ceaa5ffcf3d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.194005 Aug 31 07:06:12.586623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 346/661] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:12 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:12.628787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-363301017", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d"}], "security_groups": [{"name": "tempest-securitygroup--1850132978"}], "key_name": "tempest-keypair-174374420", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:12.637618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:12.737288 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] validate_networks() for [('fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:06:12.804237 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:12.827053 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=6 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:13.380698 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:06:13.381206 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:06:13.381936 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:06:13.382501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:06:13.383094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:06:13.393701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:13.394181 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:13.394621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:13.395370 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:13.395825 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:13.396251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:13.413205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:06:13.417764 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:06:13.430561 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:06:13.432785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:06:13.483590 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cc1beb13-b4da-49f7-87b7-6416c03743f7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.859077 Aug 31 07:06:13.484272 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 316/662] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:06:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:06:13.495245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2bca6647-a5f2-4efa-a5bc-142978df7b8c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:13.495840 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2bca6647-a5f2-4efa-a5bc-142978df7b8c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:13.566091 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2bca6647-a5f2-4efa-a5bc-142978df7b8c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:13.573470 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2bca6647-a5f2-4efa-a5bc-142978df7b8c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1240 microversion: 2.1 time: 0.082037 Aug 31 07:06:13.574061 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 347/663] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:13 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:13.610423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:13.611530 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:13.619326 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:13.619886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:13.620322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:13.621016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:13.621462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:13.621880 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:13.752187 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:13.760449 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:13.761875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:13.763106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-73c1c28f-b507-4635-8e2d-f07b42aa6cc7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.158421 Aug 31 07:06:13.763768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 317/664] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:13 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:14.359042 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-f8031f4c-62b1-47e9-a453-ebc3bfb86cf0 req-e5134f0d-b934-44bf-b8ad-68de05679547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b2fea-9e69-462c-94b4-8f6757d17252", "name": "network-vif-plugged", "status": "completed", "tag": "32f136bd-488a-4bb2-bd5b-e40227ca99a7"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:14.368793 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-f8031f4c-62b1-47e9-a453-ebc3bfb86cf0 req-e5134f0d-b934-44bf-b8ad-68de05679547 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:14.369283 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-f8031f4c-62b1-47e9-a453-ebc3bfb86cf0 req-e5134f0d-b934-44bf-b8ad-68de05679547 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:14.369694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-f8031f4c-62b1-47e9-a453-ebc3bfb86cf0 req-e5134f0d-b934-44bf-b8ad-68de05679547 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:14.382258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-f8031f4c-62b1-47e9-a453-ebc3bfb86cf0 req-e5134f0d-b934-44bf-b8ad-68de05679547 service nova] Creating event network-vif-plugged:32f136bd-488a-4bb2-bd5b-e40227ca99a7 for instance bf4b2fea-9e69-462c-94b4-8f6757d17252 on hv-cinder-85528 Aug 31 07:06:14.387278 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-f8031f4c-62b1-47e9-a453-ebc3bfb86cf0 req-e5134f0d-b934-44bf-b8ad-68de05679547 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 Aug 31 07:06:14.387867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 348/665] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:06:14.595906 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:14.596577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:14.603193 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:14.603679 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:14.604108 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:14.604799 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:14.605250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:14.605667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:14.667960 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:14.676141 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d78963bd-b266-4bca-992e-313d3fa73632 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1292 microversion: 2.1 time: 0.084306 Aug 31 07:06:14.676711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 318/666] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:14 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:14.787401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:14.788135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:14.795092 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:14.795665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:14.796107 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:14.796787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:14.797247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:14.797664 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:15.043382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:15.052733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:15.054179 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:15.055328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8fe33831-334c-425a-966c-50bad84620cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.273284 Aug 31 07:06:15.055894 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 349/667] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:14 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:15.701818 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:15.702732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:15.709668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:15.710173 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:15.710583 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:15.711310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:15.711762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:15.712186 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:15.784741 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:15.796657 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e11c73a1-e624-4e04-9b85-a845e6626164 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1298 microversion: 2.1 time: 0.101614 Aug 31 07:06:15.797222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 319/668] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:15 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:16.077982 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:16.078711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:16.085826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:16.086326 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:16.086744 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:16.087476 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:16.088598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:16.089023 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:16.223735 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:16.232296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:16.233804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:16.235058 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-36215194-7999-430c-b29a-627bdce0f609 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1406 microversion: 2.20 time: 0.161234 Aug 31 07:06:16.235632 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 350/669] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:16 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:16.829001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:16.830060 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:16.841046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:16.841849 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:16.842568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:16.843762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:16.844567 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:16.845160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:16.994940 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:17.003048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-144be130-67d2-4a6a-8804-0d6c466d3f2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.180557 Aug 31 07:06:17.008279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 320/670] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:16 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:17.257494 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:17.258108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:17.264876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:17.265358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:17.265781 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:17.266633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:17.267258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:17.267678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:17.398645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:17.407103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:17.408546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:17.409717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-de19cf4b-8a38-4445-b6c5-81efa4d850af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1598 microversion: 2.20 time: 0.156269 Aug 31 07:06:17.410469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 351/671] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:06:17 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:06:17.432452 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:17.432949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:17.439548 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:17.440034 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:17.440469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:17.441177 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:17.441628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:17.442048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:17.534012 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8afdf6c7-ce3c-4251-a312-08298006f22d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105476 Aug 31 07:06:17.534816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 321/672] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 31 07:06:17 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:06:17.626724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-a0bcbe8b-fde6-4c5e-9034-2447ef286940 req-ec95c7a6-92f3-4cb7-94ab-34a4d9af3b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60c403d-4631-4546-b33b-2c834c278fc1", "tag": "01a3fc76-54fb-46e0-8f82-c32951c96852"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:17.638702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-a0bcbe8b-fde6-4c5e-9034-2447ef286940 req-ec95c7a6-92f3-4cb7-94ab-34a4d9af3b60 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:17.639572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-a0bcbe8b-fde6-4c5e-9034-2447ef286940 req-ec95c7a6-92f3-4cb7-94ab-34a4d9af3b60 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:17.639995 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-a0bcbe8b-fde6-4c5e-9034-2447ef286940 req-ec95c7a6-92f3-4cb7-94ab-34a4d9af3b60 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:17.652215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-a0bcbe8b-fde6-4c5e-9034-2447ef286940 req-ec95c7a6-92f3-4cb7-94ab-34a4d9af3b60 service nova] Creating event network-changed:01a3fc76-54fb-46e0-8f82-c32951c96852 for instance c60c403d-4631-4546-b33b-2c834c278fc1 on hv-cinder-85528 Aug 31 07:06:17.658758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-a0bcbe8b-fde6-4c5e-9034-2447ef286940 req-ec95c7a6-92f3-4cb7-94ab-34a4d9af3b60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038342 Aug 31 07:06:17.661143 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 352/673] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:18.025825 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:18.026423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:18.033832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:18.034369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:18.034800 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:18.035756 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:18.036498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:18.036943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:18.188369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:18.196674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-70ee4bc3-e777-4293-9606-34287572d277 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.175187 Aug 31 07:06:18.197251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 322/674] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:18 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:18.509904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-a309cb34-c3ba-4e7e-9bcd-e80010470025 req-4a63f91c-79cd-40b3-b26e-ddaf18d3feb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4b2fea-9e69-462c-94b4-8f6757d17252", "tag": "32f136bd-488a-4bb2-bd5b-e40227ca99a7"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:18.520463 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-a309cb34-c3ba-4e7e-9bcd-e80010470025 req-4a63f91c-79cd-40b3-b26e-ddaf18d3feb1 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:18.520937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-a309cb34-c3ba-4e7e-9bcd-e80010470025 req-4a63f91c-79cd-40b3-b26e-ddaf18d3feb1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:18.521367 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-a309cb34-c3ba-4e7e-9bcd-e80010470025 req-4a63f91c-79cd-40b3-b26e-ddaf18d3feb1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:18.532531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-a309cb34-c3ba-4e7e-9bcd-e80010470025 req-4a63f91c-79cd-40b3-b26e-ddaf18d3feb1 service nova] Creating event network-changed:32f136bd-488a-4bb2-bd5b-e40227ca99a7 for instance bf4b2fea-9e69-462c-94b4-8f6757d17252 on hv-cinder-85528 Aug 31 07:06:18.537452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-a309cb34-c3ba-4e7e-9bcd-e80010470025 req-4a63f91c-79cd-40b3-b26e-ddaf18d3feb1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031716 Aug 31 07:06:18.538051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 353/675] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:19.217865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:19.218478 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:19.226534 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:19.227238 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:19.227763 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:19.228506 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:19.229050 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:19.229582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:19.526492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:19.536838 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-afe46341-68f2-4188-a871-2acca23432ce tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.322858 Aug 31 07:06:19.551327 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 323/676] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:19 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:20.564071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:20.564759 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:20.571967 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:20.572446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:20.572881 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:20.573578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:20.574034 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:20.574452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:20.713158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:20.721467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c4fc9299-7760-4468-9066-ef5e3c57d5a6 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.164259 Aug 31 07:06:20.722083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 354/677] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:20 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:20.862139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:20.862720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:20.869513 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:20.870003 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:20.870430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:20.871160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:20.871605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:20.872043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:20.952633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lazy-loading 'services' on Instance uuid da8ac19a-b609-4d5a-93ce-78a6abc0ee1d {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:21.025898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e8bfbf3a-cf25-4676-b153-ee621b5b04c4 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "DELETE /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments/8e596e93-ec30-4c6d-b072-42eecd2bc7d7" status: 202 len: 0 microversion: 2.1 time: 0.167575 Aug 31 07:06:21.026500 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 324/678] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:06:20 2022] DELETE /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments/8e596e93-ec30-4c6d-b072-42eecd2bc7d7 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:06:21.035105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:21.037343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:21.043715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:21.044307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:21.044626 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:21.045332 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:21.045758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:21.046180 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:21.078215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-38ea8b5b-8bce-4a42-82ab-6a4db14d938f tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047111 Aug 31 07:06:21.078831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 355/679] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:06:21 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:21.745377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:21.746278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:21.754882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:21.755591 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:21.756164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:21.757096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:21.757680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:21.758263 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:21.962381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:21.970970 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a19d8e3f-69fc-49cd-987d-1c58fa0ece37 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.231270 Aug 31 07:06:21.971922 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 325/680] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:21 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:22.089932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:22.092076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:22.099278 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:22.099758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:22.100260 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:22.100859 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:22.101305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:22.101718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:22.135255 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-53923d72-b3c2-44c2-92d7-c3b5e46d7919 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049144 Aug 31 07:06:22.140014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 356/681] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:06:22 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:22.455207 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-73e2ebd8-4c9e-4686-93c4-7f49e70aea39 req-efe2ad55-b7b2-486d-bcb0-57ceeb5db1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60c403d-4631-4546-b33b-2c834c278fc1", "name": "network-vif-plugged", "status": "completed", "tag": "01a3fc76-54fb-46e0-8f82-c32951c96852"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:22.465316 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-73e2ebd8-4c9e-4686-93c4-7f49e70aea39 req-efe2ad55-b7b2-486d-bcb0-57ceeb5db1ff service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:22.465798 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-73e2ebd8-4c9e-4686-93c4-7f49e70aea39 req-efe2ad55-b7b2-486d-bcb0-57ceeb5db1ff service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:22.466205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-73e2ebd8-4c9e-4686-93c4-7f49e70aea39 req-efe2ad55-b7b2-486d-bcb0-57ceeb5db1ff service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:22.478503 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-73e2ebd8-4c9e-4686-93c4-7f49e70aea39 req-efe2ad55-b7b2-486d-bcb0-57ceeb5db1ff service nova] Creating event network-vif-plugged:01a3fc76-54fb-46e0-8f82-c32951c96852 for instance c60c403d-4631-4546-b33b-2c834c278fc1 on hv-cinder-85528 Aug 31 07:06:22.484497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-73e2ebd8-4c9e-4686-93c4-7f49e70aea39 req-efe2ad55-b7b2-486d-bcb0-57ceeb5db1ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Aug 31 07:06:22.485528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 326/682] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:22.993553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:22.994951 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:22.997074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:23.003214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.003768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.004452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.005217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.005736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.006243 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.141331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:23.149290 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:23.149812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-41fc6ea0-fbb9-4bf5-aef0-3a6d9c158211 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.160644 Aug 31 07:06:23.150102 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 357/683] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:22 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:23.151608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:23.158106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.158659 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.159052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.159749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.160179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.160635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.191159 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b29c2234-8603-4e95-8d6c-0c3dd3446053 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046548 Aug 31 07:06:23.191702 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 327/684] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:06:23 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:06:23.271596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:23.272081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:23.278214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.278693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.279148 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.279833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.280268 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.280677 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.305688 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:06:23.387243 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4c7597b0-4009-48fc-8171-a0f87046ea0a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "DELETE /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 204 len: 0 microversion: 2.1 time: 0.119226 Aug 31 07:06:23.387834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 358/685] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:06:23 2022] DELETE /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:06:23.396986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:23.397627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:23.402995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:23.404768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.405267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.405711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.406414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:23.406949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:23.407367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:23.426293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=6 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:23.540940 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:23.549127 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4c530774-01bd-4ace-8b79-bda4bf918df5 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1687 microversion: 2.1 time: 0.156977 Aug 31 07:06:23.549697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 328/686] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:23 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:24.177460 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:24.178414 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:24.181555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=12 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:24.191116 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:24.191580 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:24.192032 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:24.192741 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:24.193198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:24.193616 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:24.324767 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:24.337122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f24714cd-d764-4f22-b1cd-00b9f1e63201 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.167298 Aug 31 07:06:24.337901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 359/687] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:24 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:24.570026 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:24.570612 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:24.577666 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:24.578156 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:24.578626 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:24.579385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:24.579884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:24.580808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:24.583438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:24.723190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:24.736079 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d999bb95-0a5f-414c-8bda-690424cab1c7 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1687 microversion: 2.1 time: 0.169921 Aug 31 07:06:24.736742 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 329/688] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:24 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:25.360067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:25.360915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:25.368003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:25.368483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:25.368907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:25.369593 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:25.370034 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:25.370451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:25.506945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:25.514755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ea7b6187-a70d-49ef-b3a1-bb5c5060a592 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.159939 Aug 31 07:06:25.515335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 360/689] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:25 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:25.764807 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:25.765553 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:25.774371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:25.774981 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:25.775497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:25.776318 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:25.776852 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:25.777355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:25.917565 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:25.928055 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ce2a445b-9dd6-4878-bcfd-6085e23f05d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1687 microversion: 2.1 time: 0.167870 Aug 31 07:06:25.928621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 330/690] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:25 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:26.536578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:26.537181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:26.544637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:26.545117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:26.545548 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:26.546228 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:26.546674 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:26.547118 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:26.691758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:26.703782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-248a2d91-779c-4898-9a2c-179be1adb6f4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.170954 Aug 31 07:06:26.704522 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 361/691] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:26 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:26.958512 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:26.959093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:26.966225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:26.966735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:26.967221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:26.967949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:26.968416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:26.968861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:27.104470 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:27.116373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0bba668f-de8e-4a32-a84e-7af6ebf765da tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1687 microversion: 2.1 time: 0.162575 Aug 31 07:06:27.117123 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 331/692] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:26 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:27.735414 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:27.736888 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:27.744233 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:27.744719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:27.745151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:27.745847 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:27.746293 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:27.746708 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:27.750901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:27.894696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:27.902592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e5834b52-50e1-4a86-801a-ec72065e6a66 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1366 microversion: 2.1 time: 0.173575 Aug 31 07:06:27.903203 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 362/693] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:27 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:28.140672 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:28.141406 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:28.149057 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:28.149524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:28.149962 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:28.150652 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:28.151134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:28.151556 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:28.310512 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:28.318578 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9dd8df48-b973-4d7e-a7ed-8c34927258aa tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1687 microversion: 2.1 time: 0.183743 Aug 31 07:06:28.319191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 332/694] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:28 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:28.926011 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:28.926608 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:28.933030 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:28.933508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:28.933932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:28.934620 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:28.935086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:28.935500 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:29.070048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:29.078231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8f1adf1d-9c44-4811-9fc0-09147b17f94f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1556 microversion: 2.1 time: 0.156241 Aug 31 07:06:29.078871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 363/695] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:28 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:06:29.098944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:29.099427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:29.105559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:29.105968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:29.106395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:29.107118 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:29.107584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:29.108001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:29.225798 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-039774c3-c697-47fd-bac9-637128aeed54 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130753 Aug 31 07:06:29.226717 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 333/696] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:06:29 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:29.339356 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:29.339967 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:29.348193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:29.348695 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:29.349125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:29.350477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:29.350477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:29.352395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:29.464539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:29.473080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-732909c7-ae60-4952-a91c-5926138b5638 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1620 microversion: 2.1 time: 0.137517 Aug 31 07:06:29.473761 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 364/697] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:29 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1620 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:29.891808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-236c0633-4347-4f07-9a12-edd705f90b65 req-89906cfb-5942-4c3e-a650-a1ae5ef608a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8ac19a-b609-4d5a-93ce-78a6abc0ee1d", "name": "network-vif-deleted", "tag": "bd463e45-bc79-4baa-970d-739b70ba4761"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:29.901529 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-236c0633-4347-4f07-9a12-edd705f90b65 req-89906cfb-5942-4c3e-a650-a1ae5ef608a9 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:29.902002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-236c0633-4347-4f07-9a12-edd705f90b65 req-89906cfb-5942-4c3e-a650-a1ae5ef608a9 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:29.902547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-236c0633-4347-4f07-9a12-edd705f90b65 req-89906cfb-5942-4c3e-a650-a1ae5ef608a9 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:29.915633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-236c0633-4347-4f07-9a12-edd705f90b65 req-89906cfb-5942-4c3e-a650-a1ae5ef608a9 service nova] Creating event network-vif-deleted:bd463e45-bc79-4baa-970d-739b70ba4761 for instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d on hv-cinder-85528 Aug 31 07:06:29.927296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-236c0633-4347-4f07-9a12-edd705f90b65 req-89906cfb-5942-4c3e-a650-a1ae5ef608a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039793 Aug 31 07:06:29.927822 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 334/698] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:30.493703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:30.494937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:30.503335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:30.507068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:30.508050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:30.509019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:30.515414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-8a45b14b-b956-4878-a17a-68d95b53dc36 req-5010d353-9290-4ccc-8293-48d0ec2bb1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60c403d-4631-4546-b33b-2c834c278fc1", "tag": "01a3fc76-54fb-46e0-8f82-c32951c96852"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:30.522780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:30.523687 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:30.533468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8a45b14b-b956-4878-a17a-68d95b53dc36 req-5010d353-9290-4ccc-8293-48d0ec2bb1ca service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:30.536101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8a45b14b-b956-4878-a17a-68d95b53dc36 req-5010d353-9290-4ccc-8293-48d0ec2bb1ca service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:30.542312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8a45b14b-b956-4878-a17a-68d95b53dc36 req-5010d353-9290-4ccc-8293-48d0ec2bb1ca service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:30.555126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-8a45b14b-b956-4878-a17a-68d95b53dc36 req-5010d353-9290-4ccc-8293-48d0ec2bb1ca service nova] Creating event network-changed:01a3fc76-54fb-46e0-8f82-c32951c96852 for instance c60c403d-4631-4546-b33b-2c834c278fc1 on hv-cinder-85528 Aug 31 07:06:30.560847 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-8a45b14b-b956-4878-a17a-68d95b53dc36 req-5010d353-9290-4ccc-8293-48d0ec2bb1ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049124 Aug 31 07:06:30.562053 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 335/699] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:06:30.572053 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:30.572330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:30.572763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:30.573208 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lazy-loading 'fault' on Instance uuid da8ac19a-b609-4d5a-93ce-78a6abc0ee1d {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:30.616465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:30.624466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b06b0f7b-1e07-40b3-8685-14d3fdd6fc57 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 200 len: 1333 microversion: 2.1 time: 0.134572 Aug 31 07:06:30.625678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 365/700] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:30 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 1333 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:31.646459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:31.647177 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: da8ac19a-b609-4d5a-93ce-78a6abc0ee1d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:31.654398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:31.654877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:31.655327 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:31.656022 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:31.656460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:31.656878 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:31.671117 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] HTTP exception thrown: Instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d could not be found. Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Request method failure captured: Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d HTTP/1.1 Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc73vfOJKsuo-lE0dkRXVMK2NY8gbtDnNYwTIseD9r9rdZF_JTTzb15NFSpIWLF9lhaSgQ5FLNKJ9e_C2MiVjXG6VZvk_NzU_EK_TGb378NDvuxSdhgk0R6mf1yu8GqR04SjBB6A9dhsxuE_iRZ0E1q4-SGrZiZqqFElHloC_NTpfA Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:06:31.672744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a83fcf85c5fc44e396c97573a73f675a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 8b9c07381f404ec39a06e01ff890da5e Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d could not be found. Aug 31 07:06:31.674341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'da8ac19a-b609-4d5a-93ce-78a6abc0ee1d'} Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d could not be found. Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:31.675191 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d could not be found. Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d could not be found. Aug 31 07:06:31.676569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:31.677844 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Returning 404 to user: Instance da8ac19a-b609-4d5a-93ce-78a6abc0ee1d could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:31.677844 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2c2a2119-2599-42a1-ad56-87e7e6509abf tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d" status: 404 len: 111 microversion: 2.1 time: 0.032021 Aug 31 07:06:31.677844 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 336/701] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:31 2022] GET /compute/v2.1/servers/da8ac19a-b609-4d5a-93ce-78a6abc0ee1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:06:31.683111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ce990fb8-569c-4d20-95ca-4f778fbe1793 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '.version_select at 0x7ff9c05d01f0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:31.703666 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ce990fb8-569c-4d20-95ca-4f778fbe1793 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63051102" status: 202 len: 0 microversion: 2.1 time: 0.024294 Aug 31 07:06:31.704218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 366/702] 10.222.0.42 () {58 vars in 1215 bytes} [Wed Aug 31 07:06:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63051102 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:06:34.602244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:34.602738 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:34.609574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:34.610061 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:34.610507 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:34.611235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:34.611663 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:34.612107 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:34.638130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:06:34.723461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a8dc24d7-b6d2-4686-9ffb-056c968a6e75 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 204 len: 0 microversion: 2.1 time: 0.124854 Aug 31 07:06:34.724344 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 337/703] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:06:34 2022] DELETE /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:06:34.733787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:34.734351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:34.741794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:34.742279 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:34.742712 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:34.743433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:34.743873 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:34.744287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:34.885756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:34.894026 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-77b1a4cf-c87b-4c7d-a1c5-7b462a1e50d0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1506 microversion: 2.1 time: 0.165046 Aug 31 07:06:34.894591 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 367/704] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:34 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:35.917527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:35.918587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:35.927628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:35.928114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:35.928559 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:35.929242 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:35.929689 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:35.930113 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:36.079074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:36.087234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4c4ad39a-775f-4122-8a02-16b1d15511c0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1506 microversion: 2.1 time: 0.174671 Aug 31 07:06:36.087794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 338/705] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:35 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:37.112941 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:37.113573 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:37.120568 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:37.121048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:37.121511 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:37.122208 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:37.122652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:37.123110 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:37.262198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:37.272727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4f5bd61c-d338-43f1-ab45-b2276d7b7816 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1506 microversion: 2.1 time: 0.166276 Aug 31 07:06:37.273295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 368/706] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:37 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:38.033414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-37d95dbe-8832-4b6d-a015-1d8c2a80ad25 req-07149b53-7188-4f5c-8d42-aaacc6d4b75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f889e287-ccdc-4c84-a33b-28a965c04abe", "name": "network-vif-deleted", "tag": "44b98252-8525-4549-989f-9dd90c026d46"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:38.045194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-37d95dbe-8832-4b6d-a015-1d8c2a80ad25 req-07149b53-7188-4f5c-8d42-aaacc6d4b75e service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:38.045668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-37d95dbe-8832-4b6d-a015-1d8c2a80ad25 req-07149b53-7188-4f5c-8d42-aaacc6d4b75e service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:38.046106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-37d95dbe-8832-4b6d-a015-1d8c2a80ad25 req-07149b53-7188-4f5c-8d42-aaacc6d4b75e service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:38.058208 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-37d95dbe-8832-4b6d-a015-1d8c2a80ad25 req-07149b53-7188-4f5c-8d42-aaacc6d4b75e service nova] Creating event network-vif-deleted:44b98252-8525-4549-989f-9dd90c026d46 for instance f889e287-ccdc-4c84-a33b-28a965c04abe on hv-cinder-85528 Aug 31 07:06:38.066672 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-37d95dbe-8832-4b6d-a015-1d8c2a80ad25 req-07149b53-7188-4f5c-8d42-aaacc6d4b75e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036995 Aug 31 07:06:38.067662 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 339/707] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:38.294213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:38.295020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:38.303079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:38.303736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:38.304363 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:38.305083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:38.305539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:38.305948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:38.347914 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:38.348461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:38.348895 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:38.349346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lazy-loading 'fault' on Instance uuid f889e287-ccdc-4c84-a33b-28a965c04abe {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:38.394615 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:38.403139 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c7b58e7c-fe65-40aa-bbd1-4d4852f4da1b tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 200 len: 1311 microversion: 2.1 time: 0.113237 Aug 31 07:06:38.403755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 369/708] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:38 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:39.428521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:39.429348 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: f889e287-ccdc-4c84-a33b-28a965c04abe] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:39.436391 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:39.436900 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:39.437359 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:39.438086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:39.438560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:39.439044 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:39.453354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] HTTP exception thrown: Instance f889e287-ccdc-4c84-a33b-28a965c04abe could not be found. Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Request method failure captured: Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe HTTP/1.1 Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc73vfOJKsuo-lE0dkRXVMK2NY8gbtDnNYwTIseD9r9rdZF_JTTzb15NFSpIWLF9lhaSgQ5FLNKJ9e_C2MiVjXG6VZvk_NzU_EK_TGb378NDvuxSdhgk0R6mf1yu8GqR04SjBB6A9dhsxuE_iRZ0E1q4-SGrZiZqqFElHloC_NTpfA Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:06:39.455054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a83fcf85c5fc44e396c97573a73f675a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 8b9c07381f404ec39a06e01ff890da5e Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance f889e287-ccdc-4c84-a33b-28a965c04abe could not be found. Aug 31 07:06:39.457024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'f889e287-ccdc-4c84-a33b-28a965c04abe'} Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f889e287-ccdc-4c84-a33b-28a965c04abe could not be found. Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:39.457842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f889e287-ccdc-4c84-a33b-28a965c04abe could not be found. Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f889e287-ccdc-4c84-a33b-28a965c04abe could not be found. Aug 31 07:06:39.459404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:39.460639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Returning 404 to user: Instance f889e287-ccdc-4c84-a33b-28a965c04abe could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:39.460639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f1b7477b-5687-4a60-b931-b12e12a3454a tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe" status: 404 len: 111 microversion: 2.1 time: 0.034431 Aug 31 07:06:39.460639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 340/709] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:39 2022] GET /compute/v2.1/servers/f889e287-ccdc-4c84-a33b-28a965c04abe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:06:39.468267 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:39.468752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:39.479152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:39.479831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:39.480437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:39.481458 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:39.481974 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:39.482521 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:39.510734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:06:39.595796 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-833ba37a-6655-49ce-8710-d552b15767ef tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "DELETE /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 204 len: 0 microversion: 2.1 time: 0.133568 Aug 31 07:06:39.596740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 370/710] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:06:39 2022] DELETE /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:06:39.605156 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:39.605805 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:39.611833 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:39.612305 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:39.612948 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:39.613490 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:39.613932 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:39.614347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:39.747952 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:39.757813 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1be49cac-36b2-4b22-b30f-18a6309e94b0 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.156563 Aug 31 07:06:39.758414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 341/711] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:39 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:06:40.779623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:40.780309 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:40.787363 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:40.787838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:40.788295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:40.789011 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:40.789451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:40.789869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:40.929063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:40.940504 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5490aa05-cb5b-42c9-941d-e60e938a4d31 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.164944 Aug 31 07:06:40.941578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 371/712] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:40 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:41.219895 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1561760453"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:41.220447 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:41.227468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:41.227954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:41.228386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:41.229082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:41.229534 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:41.229954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:41.359688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.network.security_group_api [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Removing security group 42bc2b70-11e7-44a1-8937-b4478c3f3ade from port 585a62c3-8f91-41fd-81cc-fa2d04d1cc78 Aug 31 07:06:41.685321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1ec73d78-71a3-4c8d-931d-79217f5567e4 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/action" status: 202 len: 0 microversion: 2.1 time: 0.469408 Aug 31 07:06:41.685901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 342/713] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:06:41 2022] POST /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:06:41.762434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-002c936e-efc0-40e0-96f5-0ee7092ced4f req-5c5c7808-ab73-4ddb-a22a-002069296fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55", "tag": "585a62c3-8f91-41fd-81cc-fa2d04d1cc78"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:41.776239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-002c936e-efc0-40e0-96f5-0ee7092ced4f req-5c5c7808-ab73-4ddb-a22a-002069296fbd service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:41.776690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-002c936e-efc0-40e0-96f5-0ee7092ced4f req-5c5c7808-ab73-4ddb-a22a-002069296fbd service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:41.777145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-002c936e-efc0-40e0-96f5-0ee7092ced4f req-5c5c7808-ab73-4ddb-a22a-002069296fbd service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:41.788836 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-002c936e-efc0-40e0-96f5-0ee7092ced4f req-5c5c7808-ab73-4ddb-a22a-002069296fbd service nova] Creating event network-changed:585a62c3-8f91-41fd-81cc-fa2d04d1cc78 for instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 on hv-cinder-85528 Aug 31 07:06:41.795052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-002c936e-efc0-40e0-96f5-0ee7092ced4f req-5c5c7808-ab73-4ddb-a22a-002069296fbd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103034 Aug 31 07:06:41.796239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 372/714] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:41.968914 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:41.969533 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:41.977412 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:41.977902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:41.978363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:41.979274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:41.979883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:41.980300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:42.127211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:42.135273 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-155fe6e6-7e66-4af4-b852-7177d9b31d1e tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.171128 Aug 31 07:06:42.135880 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 343/715] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:41 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:42.799626 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:42.800318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:42.809463 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:42.810217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:42.810870 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:42.811637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:42.812159 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:42.812640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:42.869428 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-fdc5b682-6dec-47ef-b3de-66136f8b4926 req-e22de7f1-d2a2-4f9d-ab5b-abb323de0c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55", "tag": "585a62c3-8f91-41fd-81cc-fa2d04d1cc78"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:42.874384 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:42.880879 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fdc5b682-6dec-47ef-b3de-66136f8b4926 req-e22de7f1-d2a2-4f9d-ab5b-abb323de0c58 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:42.881898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fdc5b682-6dec-47ef-b3de-66136f8b4926 req-e22de7f1-d2a2-4f9d-ab5b-abb323de0c58 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:42.882274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fdc5b682-6dec-47ef-b3de-66136f8b4926 req-e22de7f1-d2a2-4f9d-ab5b-abb323de0c58 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:42.895391 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-fdc5b682-6dec-47ef-b3de-66136f8b4926 req-e22de7f1-d2a2-4f9d-ab5b-abb323de0c58 service nova] Creating event network-changed:585a62c3-8f91-41fd-81cc-fa2d04d1cc78 for instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 on hv-cinder-85528 Aug 31 07:06:42.900944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-fdc5b682-6dec-47ef-b3de-66136f8b4926 req-e22de7f1-d2a2-4f9d-ab5b-abb323de0c58 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104088 Aug 31 07:06:42.902041 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 344/716] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:42.916465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lazy-loading 'services' on Instance uuid dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:42.998765 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f233ca43-a698-43bf-8d5e-bbd2102ae3fb tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments/305a8f87-e6a1-4f61-9684-41672a32eb5f" status: 202 len: 0 microversion: 2.1 time: 0.204302 Aug 31 07:06:42.999647 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 373/717] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:06:42 2022] DELETE /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments/305a8f87-e6a1-4f61-9684-41672a32eb5f => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:06:43.009019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:43.011321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:43.017618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:43.018092 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:43.018548 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:43.019256 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:43.019699 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:43.020142 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:43.053141 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-61f0018d-26bb-422f-a32d-f045cd0a6e0d tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048956 Aug 31 07:06:43.053757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 345/718] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:06:43 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:43.156453 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:43.157572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:43.164371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:43.165113 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:43.166099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:43.167014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:43.167621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:43.168401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:43.308059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:43.316601 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bf82008f-06a4-495c-8ef9-2583369d13c1 tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1520 microversion: 2.1 time: 0.164370 Aug 31 07:06:43.317533 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 374/719] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:43 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:44.069194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:44.076360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:44.085898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.090311 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.090773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.091531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.092010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.092424 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.122790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-49f746da-2a1e-4ac4-a48c-1125ebe31868 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061191 Aug 31 07:06:44.123541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 346/720] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:06:44 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:06:44.134598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:44.135196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:44.144594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.145276 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-38c456b8-2011-49cd-b49a-bd79d734f85c req-cfdec4fd-4c45-44ad-b04b-3e86a962dde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842ba2ac-ef4a-4dd0-8945-a6c32c24d16e", "name": "network-vif-deleted", "tag": "f129b399-9742-4b1f-bd20-08e795e00145"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:44.145627 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.146229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.147084 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.147925 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.148401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.156322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-38c456b8-2011-49cd-b49a-bd79d734f85c req-cfdec4fd-4c45-44ad-b04b-3e86a962dde7 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.157223 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-38c456b8-2011-49cd-b49a-bd79d734f85c req-cfdec4fd-4c45-44ad-b04b-3e86a962dde7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.157909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-38c456b8-2011-49cd-b49a-bd79d734f85c req-cfdec4fd-4c45-44ad-b04b-3e86a962dde7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.170918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-38c456b8-2011-49cd-b49a-bd79d734f85c req-cfdec4fd-4c45-44ad-b04b-3e86a962dde7 service nova] Creating event network-vif-deleted:f129b399-9742-4b1f-bd20-08e795e00145 for instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e on hv-cinder-85528 Aug 31 07:06:44.176666 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-38c456b8-2011-49cd-b49a-bd79d734f85c req-cfdec4fd-4c45-44ad-b04b-3e86a962dde7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036632 Aug 31 07:06:44.178114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 347/721] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:06:44.236989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] HTTP exception thrown: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 is not attached to volume 305a8f87-e6a1-4f61-9684-41672a32eb5f Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Request method failure captured: Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: DELETE /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments/305a8f87-e6a1-4f61-9684-41672a32eb5f HTTP/1.1 Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwe0l1Pbb6gi3Y5ePRDvbQX6JLyKjeDYxVtUUuxLIE5DCh5mOzYSjxpB8d_g83_OSSuE87zASsDisg46uDEyr1JDC0uevc8GJePJocAyWZxt0gliPfbkjqOct2HCBRiUE_UJOefS9bANvrYI9u-LPhg_kCH__TpCokoNjCljr14TQo0 Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 9fa1ad38094045b48ce0dc1bb8fa6565 Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-TestMinimumBasicScenario-1734395567 Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:06:44.240044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9fa1ad38094045b48ce0dc1bb8fa6565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9fa1ad38094045b48ce0dc1bb8fa6565"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9fa1ad38094045b48ce0dc1bb8fa6565", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9fa1ad38094045b48ce0dc1bb8fa6565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-TestMinimumBasicScenario-1734395567 Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 9fa1ad38094045b48ce0dc1bb8fa6565 Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1734395567 Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-TestMinimumBasicScenario-1734395567-project Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 8222a476868e49a1a0676ead2841030f Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-TestMinimumBasicScenario-1734395567-project Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:06:44.241415 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 is not attached to volume 305a8f87-e6a1-4f61-9684-41672a32eb5f Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'server_id': 'dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55', 'id': '305a8f87-e6a1-4f61-9684-41672a32eb5f'} Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 305a8f87-e6a1-4f61-9684-41672a32eb5f. Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:44.242245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 is not attached to volume 305a8f87-e6a1-4f61-9684-41672a32eb5f Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 is not attached to volume 305a8f87-e6a1-4f61-9684-41672a32eb5f Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:44.243947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Returning 404 to user: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 is not attached to volume 305a8f87-e6a1-4f61-9684-41672a32eb5f {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:44.245169 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c5b96aa7-8d46-4344-b8fc-6e1e23562622 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments/305a8f87-e6a1-4f61-9684-41672a32eb5f" status: 404 len: 154 microversion: 2.1 time: 0.111083 Aug 31 07:06:44.245169 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 375/722] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:06:44 2022] DELETE /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55/os-volume_attachments/305a8f87-e6a1-4f61-9684-41672a32eb5f => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:06:44.339212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:44.339833 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:44.351154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.351588 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.352216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.353273 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.353916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.354554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.392568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:44.393095 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:44.393524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:44.394157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lazy-loading 'fault' on Instance uuid 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:44.449008 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9c07381f404ec39a06e01ff890da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fcf85c5fc44e396c97573a73f675a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:44.463291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-94ef0794-87b6-4baf-a758-c23dbebcb43c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 200 len: 1311 microversion: 2.1 time: 0.128721 Aug 31 07:06:44.465294 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 348/723] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:44 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:45.394730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:45.395486 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:45.402342 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:45.402818 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:45.403269 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:45.403927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:45.404391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:45.404805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:45.432757 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:06:45.459924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:45.485557 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:45.486682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] [instance: 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:45.493677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:45.494160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:45.494593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:45.495311 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:45.495760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:45.496176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:45.501093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:45.511450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] HTTP exception thrown: Instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e could not be found. Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Request method failure captured: Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e HTTP/1.1 Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc73vfOJKsuo-lE0dkRXVMK2NY8gbtDnNYwTIseD9r9rdZF_JTTzb15NFSpIWLF9lhaSgQ5FLNKJ9e_C2MiVjXG6VZvk_NzU_EK_TGb378NDvuxSdhgk0R6mf1yu8GqR04SjBB6A9dhsxuE_iRZ0E1q4-SGrZiZqqFElHloC_NTpfA Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:06:45.513143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a83fcf85c5fc44e396c97573a73f675a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a83fcf85c5fc44e396c97573a73f675a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: a83fcf85c5fc44e396c97573a73f675a Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563016554 Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 8b9c07381f404ec39a06e01ff890da5e Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563016554-project Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e could not be found. Aug 31 07:06:45.515257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '842ba2ac-ef4a-4dd0-8945-a6c32c24d16e'} Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e could not be found. Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:45.516144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e could not be found. Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e could not be found. Aug 31 07:06:45.517754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:06:45.518901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] Returning 404 to user: Instance 842ba2ac-ef4a-4dd0-8945-a6c32c24d16e could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:45.518901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7b51439b-617b-4b8b-9137-68ead0d1e54c tempest-ServerRescueNegativeTestJSON-563016554 tempest-ServerRescueNegativeTestJSON-563016554-project] 10.222.0.42 "GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e" status: 404 len: 111 microversion: 2.1 time: 0.033286 Aug 31 07:06:45.518901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 349/724] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:45 2022] GET /compute/v2.1/servers/842ba2ac-ef4a-4dd0-8945-a6c32c24d16e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:06:45.519160 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-50c1074e-2e51-4670-9c63-bb7c093d71c6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 204 len: 0 microversion: 2.1 time: 0.126978 Aug 31 07:06:45.519160 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 376/725] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:06:45 2022] DELETE /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:06:45.527485 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:45.527967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:45.535633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:45.536111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:45.536548 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:45.537244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:45.537692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:45.538115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:45.665724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:45.673504 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-80cd8adb-3e6a-4f7e-a586-2b977570301b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1554 microversion: 2.1 time: 0.150237 Aug 31 07:06:45.674037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 350/726] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:45 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:06:46.695784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:46.696463 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:46.703461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:46.703926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:46.704356 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:46.705054 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:46.705500 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:46.705916 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:46.919098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:46.927950 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-43c4a5df-0aff-40f2-ab83-d60861859b70 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1554 microversion: 2.1 time: 0.236477 Aug 31 07:06:46.928523 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 377/727] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:46 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:47.949382 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:47.950664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:47.965598 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:47.966360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:47.967024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:47.967904 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:47.968509 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:47.969087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:48.391870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:48.407076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-112e9e37-4c7f-4a5c-994c-7809a6739ae1 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1554 microversion: 2.1 time: 0.461668 Aug 31 07:06:48.408704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 351/728] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:47 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1554 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:06:48.620501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-85bcb5b1-9de2-4780-a435-cb7f656bf0ec req-96ad7a47-2e17-441a-9d3b-fb04cd35087f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55", "name": "network-vif-deleted", "tag": "585a62c3-8f91-41fd-81cc-fa2d04d1cc78"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:48.631531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-85bcb5b1-9de2-4780-a435-cb7f656bf0ec req-96ad7a47-2e17-441a-9d3b-fb04cd35087f service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:48.632321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-85bcb5b1-9de2-4780-a435-cb7f656bf0ec req-96ad7a47-2e17-441a-9d3b-fb04cd35087f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:48.632928 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-85bcb5b1-9de2-4780-a435-cb7f656bf0ec req-96ad7a47-2e17-441a-9d3b-fb04cd35087f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:48.645817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-85bcb5b1-9de2-4780-a435-cb7f656bf0ec req-96ad7a47-2e17-441a-9d3b-fb04cd35087f service nova] Creating event network-vif-deleted:585a62c3-8f91-41fd-81cc-fa2d04d1cc78 for instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 on hv-cinder-85528 Aug 31 07:06:48.662251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-85bcb5b1-9de2-4780-a435-cb7f656bf0ec req-96ad7a47-2e17-441a-9d3b-fb04cd35087f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045159 Aug 31 07:06:48.663297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 378/729] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:06:49.430774 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:49.432217 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:49.440786 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:49.441507 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:49.442369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:49.443203 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:49.443651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:49.444067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:49.479865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:49.480562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:49.481178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:49.481965 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lazy-loading 'fault' on Instance uuid dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:06:49.531455 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222a476868e49a1a0676ead2841030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1ad38094045b48ce0dc1bb8fa6565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:49.539468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-566fac04-889d-4c1b-a636-d1695576309b tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 200 len: 1349 microversion: 2.1 time: 0.113400 Aug 31 07:06:49.539882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 352/730] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:49 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 1349 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:06:50.562585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:50.563503 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] [instance: dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:50.570783 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:50.571316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:50.571943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:50.572870 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:50.573352 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:50.574034 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:50.588432 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] HTTP exception thrown: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 could not be found. Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Request method failure captured: Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 HTTP/1.1 Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwe0l1Pbb6gi3Y5ePRDvbQX6JLyKjeDYxVtUUuxLIE5DCh5mOzYSjxpB8d_g83_OSSuE87zASsDisg46uDEyr1JDC0uevc8GJePJocAyWZxt0gliPfbkjqOct2HCBRiUE_UJOefS9bANvrYI9u-LPhg_kCH__TpCokoNjCljr14TQo0 Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 9fa1ad38094045b48ce0dc1bb8fa6565 Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-TestMinimumBasicScenario-1734395567 Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:06:50.590104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9fa1ad38094045b48ce0dc1bb8fa6565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9fa1ad38094045b48ce0dc1bb8fa6565"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9fa1ad38094045b48ce0dc1bb8fa6565", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9fa1ad38094045b48ce0dc1bb8fa6565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-TestMinimumBasicScenario-1734395567 Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 9fa1ad38094045b48ce0dc1bb8fa6565 Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1734395567 Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-TestMinimumBasicScenario-1734395567-project Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 8222a476868e49a1a0676ead2841030f Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-TestMinimumBasicScenario-1734395567-project Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 could not be found. Aug 31 07:06:50.591518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55'} Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 could not be found. Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:06:50.592238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 could not be found. Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 could not be found. Aug 31 07:06:50.593459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:06:50.594555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Returning 404 to user: Instance dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:06:50.594555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5e059c2a-ff90-4d81-add4-6e9a093c71d6 tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55" status: 404 len: 111 microversion: 2.1 time: 0.033875 Aug 31 07:06:50.594555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 379/731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:50 2022] GET /compute/v2.1/servers/dc2eb3e7-ccac-464f-8b92-9bdbf95ebc55 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:06:50.600891 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8ee040ed-45eb-4aeb-9fb8-57752c2f92de tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] Calling method '.version_select at 0x7ff9c04c5790>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:50.623469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8ee040ed-45eb-4aeb-9fb8-57752c2f92de tempest-TestMinimumBasicScenario-1734395567 tempest-TestMinimumBasicScenario-1734395567-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1649367427" status: 202 len: 0 microversion: 2.1 time: 0.026930 Aug 31 07:06:50.624051 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 353/732] 10.222.0.42 () {58 vars in 1272 bytes} [Wed Aug 31 07:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1649367427 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 07:06:56.906080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6be9da34-46d7-4786-bba1-9c48593ac862 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'create', calling method: .version_select at 0x7ff9c0607af0>, body: {"keypair": {"name": "tempest-keypair-1885064642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETEY6NwFwt07CZyUzwuyy6xuzawcGnKks8hjtnfNm/0jeVYbpPATSED4ohDxBnKY2EJaMsX+N4ly8EajGN1B5cyVFF0Rp3PQ49X03HFqkQwMKZva+AIARtW40xM7xAzuA=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:56.916916 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:06:56.928359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-6be9da34-46d7-4786-bba1-9c48593ac862 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:06:56.937255 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-6be9da34-46d7-4786-bba1-9c48593ac862 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for user ce4e97b4b681489e8c427ea3846b62c6 and project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:06:56.994493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6be9da34-46d7-4786-bba1-9c48593ac862 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.243222 Aug 31 07:06:56.996328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 380/733] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:06:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:06:58.427365 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-566458563", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a96f0399-d3ea-4de7-a42f-ba811bd374c8"}], "security_groups": [{"name": "tempest-securitygroup--979194567"}], "key_name": "tempest-keypair-1885064642", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:06:58.675989 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] validate_networks() for [('a96f0399-d3ea-4de7-a42f-ba811bd374c8', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:06:59.447660 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:06:59.448195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:06:59.448963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:06:59.449381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:06:59.449792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:06:59.459677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:59.460352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:59.460941 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:59.461795 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:06:59.462427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:06:59.463050 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:06:59.493735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:06:59.500485 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for user ce4e97b4b681489e8c427ea3846b62c6 and project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:06:59.517584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:06:59.521054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:06:59.600794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-56ef3ecc-cf88-435a-91c8-5c38ea7ec75a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.178929 Aug 31 07:06:59.607189 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 354/734] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:06:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 07:06:59.614741 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bccad48c-29b0-4072-94f6-d69a2a4bdc01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:06:59.615680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bccad48c-29b0-4072-94f6-d69a2a4bdc01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:06:59.727933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bccad48c-29b0-4072-94f6-d69a2a4bdc01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:06:59.738145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bccad48c-29b0-4072-94f6-d69a2a4bdc01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1237 microversion: 2.1 time: 0.129413 Aug 31 07:06:59.740073 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 381/735] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:06:59 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1237 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:00.759868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:00.761059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:00.769072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:00.769908 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:00.770551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:00.771552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:00.772257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:00.773025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:00.863069 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:00.872577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9cb2ccbb-360a-46b9-828a-3606fa210676 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1289 microversion: 2.1 time: 0.117852 Aug 31 07:07:00.886199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 355/736] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:00 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:01.895724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:01.896520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:01.898689 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:01.904756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:01.905301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:01.905971 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:01.906746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:01.907306 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:01.907810 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:02.070477 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:02.079775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f913e575-5afb-42b5-a63b-e9d5630e351b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.187793 Aug 31 07:07:02.080959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 382/737] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:01 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:02.264828 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:02.265504 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:02.272377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:02.272994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:02.273518 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:02.274451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:02.275253 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:02.275768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:02.302420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6dd79144-06f9-422a-8dc8-4ce3a39c36f5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/ips" status: 200 len: 152 microversion: 2.20 time: 0.042250 Aug 31 07:07:02.303174 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 356/738] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 31 07:07:02 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:07:02.756128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-d1c07a25-648c-43c1-ace9-109c21a6b18c req-ec4fc2c6-ba69-4a08-9be2-c46d002e037e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7580179a-eac1-45f0-ab8f-0bb0572699af", "tag": "0afb8a58-774f-421f-a423-54b2b634db6d"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:02.765837 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d1c07a25-648c-43c1-ace9-109c21a6b18c req-ec4fc2c6-ba69-4a08-9be2-c46d002e037e service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:02.766328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d1c07a25-648c-43c1-ace9-109c21a6b18c req-ec4fc2c6-ba69-4a08-9be2-c46d002e037e service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:02.766736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d1c07a25-648c-43c1-ace9-109c21a6b18c req-ec4fc2c6-ba69-4a08-9be2-c46d002e037e service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:02.778101 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-d1c07a25-648c-43c1-ace9-109c21a6b18c req-ec4fc2c6-ba69-4a08-9be2-c46d002e037e service nova] Creating event network-changed:0afb8a58-774f-421f-a423-54b2b634db6d for instance 7580179a-eac1-45f0-ab8f-0bb0572699af on hv-cinder-85528 Aug 31 07:07:02.783593 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-d1c07a25-648c-43c1-ace9-109c21a6b18c req-ec4fc2c6-ba69-4a08-9be2-c46d002e037e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 Aug 31 07:07:02.784190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 383/739] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:03.102978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:03.103584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:03.109816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:03.110296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:03.110746 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:03.111466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:03.111937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:03.112314 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:03.512279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:03.520076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4197d02d-13bc-4951-ae40-92335e82b388 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.421187 Aug 31 07:07:03.520645 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 357/740] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:03 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:04.246390 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:04.247025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:04.253872 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:04.254356 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:04.254780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:04.255491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:04.256043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:04.256656 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:04.280331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lazy-loading 'flavor' on Instance uuid bf4b2fea-9e69-462c-94b4-8f6757d17252 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:07:04.477434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b6f8111f-8991-44b0-8105-3098f20de169 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/action" status: 202 len: 0 microversion: 2.20 time: 0.235819 Aug 31 07:07:04.478032 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 384/741] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 07:07:04 2022] POST /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:07:04.486581 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:04.487309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:04.493934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:04.494418 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:04.494873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:04.495621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:04.496000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:04.496419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:04.541847 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:04.543975 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:04.551189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:04.551654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:04.552158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:04.552871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:04.553318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:04.553740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:04.680479 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:04.688988 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:04.690419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:04.690651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:04.691602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5310996e-839e-4f3d-a269-916952d8db2e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.209210 Aug 31 07:07:04.692165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 358/742] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:04 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:07:04.698653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b46697de-61ab-4d97-b669-bfb9d98ae71a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.161605 Aug 31 07:07:04.699344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 385/743] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:04 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:05.719360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:05.720538 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:05.723581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:05.724618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:05.732269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:05.733100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:05.733817 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:05.734995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:05.735710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:05.735947 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:05.736497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:05.736732 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:05.737213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:05.738356 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:05.739232 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:05.740028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:05.879929 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:05.880414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:05.888044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d0f26557-e53d-47fa-b9b3-117684d09f5a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.171256 Aug 31 07:07:05.891224 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:05.892654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:05.893064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 386/744] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:05 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:05.893814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-84a1787c-40e7-4915-8c06-c8851a0076af tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.181378 Aug 31 07:07:05.894360 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 359/745] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:05 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:07:06.610927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:06.611805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:06.619258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:06.619747 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:06.620175 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:06.620870 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:06.621315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:06.621736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:06.645296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d60486c0-1c34-4c61-8b0e-2ba7d07af28e tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/ips" status: 200 len: 150 microversion: 2.1 time: 0.040983 Aug 31 07:07:06.645877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 387/746] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:07:06 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:06.907540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:06.908197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:06.917408 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:06.917996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:06.925212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:06.925651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:06.926084 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:06.926784 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:06.927480 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:06.927835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:06.934200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:06.934681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:06.935132 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:06.935829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:06.936279 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:06.936695 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:07.073821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:07.074235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:07.082130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-79c48943-96ad-48bb-ab49-cbb8047bf93e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.178372 Aug 31 07:07:07.082596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:07.082739 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 360/747] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:06 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:07.084481 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:07.085725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1c60acc1-da84-4d14-9ffb-0ab3f2d56b09 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.172581 Aug 31 07:07:07.086262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 388/748] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:06 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:07.984018 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8c7b46a-6de1-48f9-ad13-850cc247c2f7"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:07.986459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:07.993789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:07.994265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:07.994725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:07.995441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:07.995881 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:07.996302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:08.104544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:08.105186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:08.112499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:08.112983 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:08.113412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:08.114103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:08.114573 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:08.115062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:08.252338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:08.262170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1d98265f-3677-4cea-9445-b30047adadc0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.162767 Aug 31 07:07:08.262759 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 389/749] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:08 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:08.267471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:08.268068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:08.274694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:08.275301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:08.276048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:08.276861 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:08.277373 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:08.277792 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:08.281708 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a484d474-d6c6-4fc4-a5ef-f4d477d05dda tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301553 Aug 31 07:07:08.288179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 361/750] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:07:07 2022] POST /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:08.420302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:08.428756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:08.430210 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:08.431396 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c0b81a9e-9e72-4c27-8819-b172bd79bb36 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.167516 Aug 31 07:07:08.431957 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 390/751] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:08 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:08.990736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-6e63cd5f-b793-4be5-a10d-a5b81b92dfdd req-9d80df10-3363-4f68-81eb-6c1ac25f3971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7580179a-eac1-45f0-ab8f-0bb0572699af", "name": "network-vif-plugged", "status": "completed", "tag": "0afb8a58-774f-421f-a423-54b2b634db6d"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:09.000541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-6e63cd5f-b793-4be5-a10d-a5b81b92dfdd req-9d80df10-3363-4f68-81eb-6c1ac25f3971 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:09.001010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-6e63cd5f-b793-4be5-a10d-a5b81b92dfdd req-9d80df10-3363-4f68-81eb-6c1ac25f3971 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:09.001435 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-6e63cd5f-b793-4be5-a10d-a5b81b92dfdd req-9d80df10-3363-4f68-81eb-6c1ac25f3971 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:09.012409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-6e63cd5f-b793-4be5-a10d-a5b81b92dfdd req-9d80df10-3363-4f68-81eb-6c1ac25f3971 service nova] Creating event network-vif-plugged:0afb8a58-774f-421f-a423-54b2b634db6d for instance 7580179a-eac1-45f0-ab8f-0bb0572699af on hv-cinder-85528 Aug 31 07:07:09.017350 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-6e63cd5f-b793-4be5-a10d-a5b81b92dfdd req-9d80df10-3363-4f68-81eb-6c1ac25f3971 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217641 Aug 31 07:07:09.017930 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 362/752] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:09.289022 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:09.290128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:09.301592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:09.302406 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:09.303204 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:09.304736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:09.305194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:09.305623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:09.454330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:09.455197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:09.455886 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:09.463328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:09.463805 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:09.464069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-51c91f80-2fd8-4d13-bb8d-c2e2222ada8c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.182473 Aug 31 07:07:09.464899 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 391/753] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:09 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:09.465044 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:09.465785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:09.466265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:09.466790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:09.472921 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:09.513023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=6 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:09.613441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:09.622697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:09.624157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:09.625312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-469a7168-5768-40d8-b13e-a47166f15806 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.175229 Aug 31 07:07:09.625870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 363/754] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:09 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:07:10.485309 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:10.485914 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:10.488044 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=6 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:10.494001 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.494528 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.495003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.495714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.496167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.496588 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.558170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8c7b46a-6de1-48f9-ad13-850cc247c2f7"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:10.560600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:10.567102 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.567577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.568005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.568694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.569145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.569563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.627779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:10.635785 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ad28088c-1716-4dd1-9b7c-b656bacba8e0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1362 microversion: 2.1 time: 0.154330 Aug 31 07:07:10.636367 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 392/755] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:10 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:10.649462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:10.649462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:10.651293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Invalid volume: volume b8c7b46a-6de1-48f9-ad13-850cc247c2f7 is already attached to instances: c60c403d-4631-4546-b33b-2c834c278fc1 Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: POST /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments HTTP/1.1 Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 74 Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:07:10.653078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {"volumeAttachment": {"volumeId": "b8c7b46a-6de1-48f9-ad13-850cc247c2f7"}} Aug 31 07:07:10.654704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Invalid volume: volume b8c7b46a-6de1-48f9-ad13-850cc247c2f7 is already attached to instances: c60c403d-4631-4546-b33b-2c834c278fc1 Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'server_id': 'c60c403d-4631-4546-b33b-2c834c278fc1', 'body': {'volumeAttachment': {'volumeId': 'b8c7b46a-6de1-48f9-ad13-850cc247c2f7'}}} Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b8c7b46a-6de1-48f9-ad13-850cc247c2f7 is already attached to instances: c60c403d-4631-4546-b33b-2c834c278fc1 Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:10.655603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b8c7b46a-6de1-48f9-ad13-850cc247c2f7 is already attached to instances: c60c403d-4631-4546-b33b-2c834c278fc1 Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:10.656875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:07:10.658195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:07:10.658195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:07:10.658195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:07:10.658195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b8c7b46a-6de1-48f9-ad13-850cc247c2f7 is already attached to instances: c60c403d-4631-4546-b33b-2c834c278fc1 Aug 31 07:07:10.658195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:10.658195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 400 to user: Invalid volume: volume b8c7b46a-6de1-48f9-ad13-850cc247c2f7 is already attached to instances: c60c403d-4631-4546-b33b-2c834c278fc1 {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:07:10.658195 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-93140e9b-32d2-4680-9106-77a571b81a86 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100849 Aug 31 07:07:10.658700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.658700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.659014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 364/756] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:07:10 2022] POST /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 07:07:10.659097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.659097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.659097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.659097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.720942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:10.721345 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:10.727946 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.728430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.728867 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.729734 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.730197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.730633 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.792040 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:10.800263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:10.801772 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:10.803052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1c7a6aca-5851-4574-b66a-ee7b9ea96d3f tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.158980 Aug 31 07:07:10.803685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 393/757] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:10 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:10.815501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lazy-loading 'services' on Instance uuid c60c403d-4631-4546-b33b-2c834c278fc1 {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:07:10.896427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e43438a7-5558-46b3-a1e7-4364f8836628 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments/b8c7b46a-6de1-48f9-ad13-850cc247c2f7" status: 202 len: 0 microversion: 2.1 time: 0.179540 Aug 31 07:07:10.897010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 365/758] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:07:10 2022] DELETE /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments/b8c7b46a-6de1-48f9-ad13-850cc247c2f7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:07:10.905630 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:10.907989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:10.915434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.916312 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.916748 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.917438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:10.917888 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:10.918307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:10.948725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f0246874-0212-4753-ac81-df317ca44dbe tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047101 Aug 31 07:07:10.949284 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 394/759] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:07:10 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:11.663216 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:11.664243 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:11.675222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.676001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.676701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.677794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.678520 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.679208 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.826060 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:11.826666 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:11.827397 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:11.829746 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:11.833095 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.833563 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.833987 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.834671 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.835141 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.835557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.836685 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ef42f63b-16a4-408a-a974-0dcf0ecb77dd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1547 microversion: 2.1 time: 0.181416 Aug 31 07:07:11.837256 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 366/760] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:11 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:11.857552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:11.858030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:11.864705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.865186 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.865615 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.866310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.866751 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.867193 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.947016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-40d4af0a-cf0d-410e-ae7f-34fb45a4b2a8 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093786 Aug 31 07:07:11.947802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 367/761] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:07:11 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:07:11.961545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:11.963836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:11.970079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:11.976664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.977213 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.977790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.978501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:11.978961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:11.979103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:11.979397 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:11.980441 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:11.981784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5bf63c8c-d9a0-4633-810a-ad0673a12bf3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.159765 Aug 31 07:07:11.982736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 395/762] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:11 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:12.010589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-520ff3ad-a5d3-4d2c-a3e2-858cb0e8de06 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053052 Aug 31 07:07:12.011403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 368/763] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:07:11 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:07:12.904048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-50cee743-f63d-42b1-9670-536cf8384c37 req-0ebd1df1-4d68-448e-a4da-4110a2bda614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7580179a-eac1-45f0-ab8f-0bb0572699af", "tag": "0afb8a58-774f-421f-a423-54b2b634db6d"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:12.914106 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-50cee743-f63d-42b1-9670-536cf8384c37 req-0ebd1df1-4d68-448e-a4da-4110a2bda614 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:12.914672 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-50cee743-f63d-42b1-9670-536cf8384c37 req-0ebd1df1-4d68-448e-a4da-4110a2bda614 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:12.915135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-50cee743-f63d-42b1-9670-536cf8384c37 req-0ebd1df1-4d68-448e-a4da-4110a2bda614 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:12.926771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-50cee743-f63d-42b1-9670-536cf8384c37 req-0ebd1df1-4d68-448e-a4da-4110a2bda614 service nova] Creating event network-changed:0afb8a58-774f-421f-a423-54b2b634db6d for instance 7580179a-eac1-45f0-ab8f-0bb0572699af on hv-cinder-85528 Aug 31 07:07:12.931965 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-50cee743-f63d-42b1-9670-536cf8384c37 req-0ebd1df1-4d68-448e-a4da-4110a2bda614 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031681 Aug 31 07:07:12.932598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 396/764] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:13.005780 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:13.007038 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:13.013991 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.014477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.015156 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.015892 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.016632 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.016757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.028694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:13.032059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:13.039993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.040601 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.041621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.042538 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.043211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.043824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.077940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-56e5fc8e-1253-4cb0-8a8a-afb378668eb4 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058568 Aug 31 07:07:13.078531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 397/765] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:07:13 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:07:13.147073 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:13.147696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:13.154716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.155428 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.155959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.157037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.157287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.157824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.163618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:13.191629 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:07:13.277516 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:13.285533 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-aa229a44-7f89-4b13-9a7c-a540a40b047a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 204 len: 0 microversion: 2.1 time: 0.142095 Aug 31 07:07:13.286147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 398/766] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:07:13 2022] DELETE /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 07:07:13.288977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:13.290529 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:13.292109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-eaa18c91-22b3-4034-93ec-7023ae9a2ed4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.290319 Aug 31 07:07:13.292944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 369/767] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:13 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:13.296830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:13.297625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:13.303779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.304359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.305029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.305846 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:13.306509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:13.307037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:13.447728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:13.455634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-dfd5d323-1025-4f20-9a15-45db11dfbc47 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1681 microversion: 2.1 time: 0.163109 Aug 31 07:07:13.456201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 399/768] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:13 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:14.320539 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:14.321576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:14.324171 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:14.330232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:14.330737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:14.331222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:14.331944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:14.332417 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:14.332861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:14.472254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:14.477318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:14.477943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:14.480704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:14.482130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:14.483300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dec9c9b6-0c14-49b3-934c-ca0478f9b842 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.169512 Aug 31 07:07:14.483872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 370/769] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:14 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:14.484553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:14.485033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:14.485465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:14.486214 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:14.486599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:14.487056 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:14.616088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:14.624599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-67dea8d6-06c6-4805-a299-70601f8d5fc9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1681 microversion: 2.1 time: 0.151103 Aug 31 07:07:14.625170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 400/770] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:14 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:15.505931 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:15.506566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:15.513466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:15.513946 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:15.514409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:15.515212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:15.515667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:15.516076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:15.646329 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:15.646999 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:15.653797 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:15.654278 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:15.654722 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:15.655468 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:15.655921 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:15.656345 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:15.775143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:15.784090 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:15.785694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:15.786981 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8a28a99e-532e-411a-acb3-3dd469162d47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1744 microversion: 2.20 time: 0.285079 Aug 31 07:07:15.787224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:15.795696 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 371/771] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:15 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1744 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:15.798312 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-cd3169ce-7b5a-450a-a189-8e8c9c70a6b8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1681 microversion: 2.1 time: 0.155509 Aug 31 07:07:15.799011 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 401/772] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:15 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:16.454421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-01a65161-58a7-4171-bc8b-1fa39f47a72e req-4ca3bfe6-aa07-4a44-9310-13ca69ebe511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60c403d-4631-4546-b33b-2c834c278fc1", "name": "network-vif-deleted", "tag": "01a3fc76-54fb-46e0-8f82-c32951c96852"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:16.464911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-01a65161-58a7-4171-bc8b-1fa39f47a72e req-4ca3bfe6-aa07-4a44-9310-13ca69ebe511 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:16.465386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-01a65161-58a7-4171-bc8b-1fa39f47a72e req-4ca3bfe6-aa07-4a44-9310-13ca69ebe511 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:16.465808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-01a65161-58a7-4171-bc8b-1fa39f47a72e req-4ca3bfe6-aa07-4a44-9310-13ca69ebe511 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:16.477068 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-01a65161-58a7-4171-bc8b-1fa39f47a72e req-4ca3bfe6-aa07-4a44-9310-13ca69ebe511 service nova] Creating event network-vif-deleted:01a3fc76-54fb-46e0-8f82-c32951c96852 for instance c60c403d-4631-4546-b33b-2c834c278fc1 on hv-cinder-85528 Aug 31 07:07:16.483495 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-01a65161-58a7-4171-bc8b-1fa39f47a72e req-4ca3bfe6-aa07-4a44-9310-13ca69ebe511 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032029 Aug 31 07:07:16.483495 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 372/773] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:07:16.811167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:16.811725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:16.820607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:16.821361 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:16.822004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:16.822985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:16.823652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:16.824219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:16.834976 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:16.836363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:16.845176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:16.845755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:16.846487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:16.847291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:16.847986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:16.848481 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:16.884512 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:16.885046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:16.885491 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:16.885941 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lazy-loading 'fault' on Instance uuid c60c403d-4631-4546-b33b-2c834c278fc1 {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:07:16.935502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:16.943595 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-fda3fdd9-763e-4baf-8bd9-6f8370ae560b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 200 len: 1330 microversion: 2.1 time: 0.120270 Aug 31 07:07:16.944267 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 373/774] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:16 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 1330 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:16.977152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:16.986600 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:16.988082 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:16.989247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a12c4238-134b-4fdb-8abe-727e8e63312b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1744 microversion: 2.20 time: 0.182477 Aug 31 07:07:16.989809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 402/775] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:16 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:17.967606 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:17.968460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:17.979279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:17.979653 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:17.980394 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:17.981406 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:17.982081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:17.982715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:18.003569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 HTTP/1.1 Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:07:18.006046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:07:18.007692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'c60c403d-4631-4546-b33b-2c834c278fc1'} Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:07:18.008607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:07:18.010312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:07:18.011540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:07:18.011540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2628a43e-a156-4a2d-b82c-01dbbb83d2e9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 404 len: 111 microversion: 2.1 time: 0.046155 Aug 31 07:07:18.011540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 374/776] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:17 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:07:18.017434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ecd2b810-01e6-4e5a-867b-9732e35bcd9b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '.version_select at 0x7ff9c0588b80>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:18.022964 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:18.023670 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:18.030637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:18.031317 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:18.031797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:18.032603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:18.033204 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:18.033694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:18.038327 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ecd2b810-01e6-4e5a-867b-9732e35bcd9b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-174374420" status: 202 len: 0 microversion: 2.1 time: 0.024804 Aug 31 07:07:18.039484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 403/777] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 31 07:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-174374420 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:07:18.227058 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:18.242363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:18.252215 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:18.253587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e2bdd731-7e37-4904-8494-ea793c93f06c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.235499 Aug 31 07:07:18.269986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 375/778] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:18 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:18.888689 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c524815d-a59b-4e5a-aa97-6c728bbe0b80 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: .version_select at 0x7ff9c059d0d0>, body: {"keypair": {"name": "tempest-keypair-669934674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErt8jIY9EPdzCUuHkP1WP/a6Vci7T/LdVophu/6mDYGaMpqkzPm+GfX5cOXKzJgsIgaIcPg+Ep9hKBlCaiwPJREWi6/RBi7UkM9y/yM4zBZMnSyhILyBlSPIF6twDZxvA=="}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:18.890519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-85899cde-4bbe-4d30-bbd9-e83342d30b7a req-0a1e4255-bfbc-443d-a990-3ad873961933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b2fea-9e69-462c-94b4-8f6757d17252", "name": "network-vif-plugged", "status": "completed", "tag": "32f136bd-488a-4bb2-bd5b-e40227ca99a7"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:18.905684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-85899cde-4bbe-4d30-bbd9-e83342d30b7a req-0a1e4255-bfbc-443d-a990-3ad873961933 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:18.906202 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-85899cde-4bbe-4d30-bbd9-e83342d30b7a req-0a1e4255-bfbc-443d-a990-3ad873961933 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:18.906639 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-85899cde-4bbe-4d30-bbd9-e83342d30b7a req-0a1e4255-bfbc-443d-a990-3ad873961933 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:18.915294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-c524815d-a59b-4e5a-aa97-6c728bbe0b80 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:07:18.921199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-85899cde-4bbe-4d30-bbd9-e83342d30b7a req-0a1e4255-bfbc-443d-a990-3ad873961933 service nova] Creating event network-vif-plugged:32f136bd-488a-4bb2-bd5b-e40227ca99a7 for instance bf4b2fea-9e69-462c-94b4-8f6757d17252 on hv-cinder-85528 Aug 31 07:07:18.922498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-c524815d-a59b-4e5a-aa97-6c728bbe0b80 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'key_pairs'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:07:18.929190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-85899cde-4bbe-4d30-bbd9-e83342d30b7a req-0a1e4255-bfbc-443d-a990-3ad873961933 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044729 Aug 31 07:07:18.930190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 376/779] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:18.958093 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c524815d-a59b-4e5a-aa97-6c728bbe0b80 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077947 Aug 31 07:07:18.965871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 404/780] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:07:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:19.282660 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:19.283971 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:19.297961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:19.298820 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:19.299218 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:19.300192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:19.300794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:19.301454 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:19.502944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:19.514277 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:19.516105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:19.517336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f6c36df2-d9bc-4a26-8755-feaa2b973dd7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.242779 Aug 31 07:07:19.518061 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 377/781] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:19 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:20.548357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:20.548989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:20.556773 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:20.557433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:20.558050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:20.558954 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:20.559393 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:20.559961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:20.602918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1313436377", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d"}], "security_groups": [{"name": "tempest-securitygroup--656918744"}], "key_name": "tempest-keypair-669934674", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:20.726315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:20.737809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:20.741025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:20.743072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f08a954f-8193-4e2a-9f85-741015013597 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.198856 Aug 31 07:07:20.744514 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 405/782] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:20 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:07:20.769097 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] validate_networks() for [('fb57f6f0-61a3-4b5f-acf8-ba7374e6fa6d', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:07:21.196460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:07:21.197320 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:07:21.197965 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:07:21.198370 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:07:21.198778 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:07:21.210588 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:21.211094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:21.211527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:21.212406 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:21.212852 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:21.213268 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:21.234088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:07:21.238601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Getting quotas for user 7a2649ceb85846a18f4e4a3e39af712e and project 727ae12d19534c1db445f58beceded41. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:07:21.252786 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:07:21.255142 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:07:21.315434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b9006283-9fa7-4731-8245-fcae39165922 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715178 Aug 31 07:07:21.319003 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 378/783] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:07:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 07:07:21.327575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-26dddc91-6536-4ddb-85bd-41ad83ff5848 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:21.328311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-26dddc91-6536-4ddb-85bd-41ad83ff5848 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:21.413068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-26dddc91-6536-4ddb-85bd-41ad83ff5848 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:21.421020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-26dddc91-6536-4ddb-85bd-41ad83ff5848 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1241 microversion: 2.1 time: 0.097425 Aug 31 07:07:21.437372 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 406/784] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:21 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:21.772345 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:21.773201 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:21.782705 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:21.783491 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:21.784228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:21.785222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:21.786025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:21.786676 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:21.961363 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:21.975024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:21.979249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:21.980541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-88adc5bb-b9f8-4606-a5c9-2fbc6dee095d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.213729 Aug 31 07:07:21.981636 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 379/785] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:21 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:22.445977 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:22.447883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:22.454650 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:22.455162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:22.455843 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:22.456689 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:22.457579 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:22.458199 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:22.524201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:22.533219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-60806745-2343-4d44-9691-8efc27271d2d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1293 microversion: 2.1 time: 0.092406 Aug 31 07:07:22.534037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 407/786] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:22 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:23.005320 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:23.006174 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:23.016938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:23.017821 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:23.018462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:23.019556 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:23.020317 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:23.020937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:23.266226 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:23.279126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:23.282758 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:23.285526 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-424a2da8-4290-4e5f-b2c4-d9cade8998cb tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.284799 Aug 31 07:07:23.297371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 380/787] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:22 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:23.555875 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:23.557301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:23.566399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:23.567343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:23.567957 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:23.570421 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:23.571089 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:23.572151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:23.654497 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:23.669876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ae44fe02-68c9-4d5c-abc6-7a75b29abd97 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1299 microversion: 2.1 time: 0.117999 Aug 31 07:07:23.684441 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 408/788] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:23 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:24.313231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:24.314967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:24.321460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:24.322328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:24.323165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:24.324009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:24.324759 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:24.325726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:24.539431 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:24.548862 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:24.550440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:24.551883 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-53431ff6-de06-4dfd-977a-4510c87f2fb4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.245974 Aug 31 07:07:24.553228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 381/789] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:24 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 07:07:24.695849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:24.696461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:24.705718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:24.706412 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:24.707229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:24.708717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:24.709196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:24.709673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:24.796589 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-8a6b4a75-cd1d-4ecb-aad8-98ae54b56fa5 req-58502aa3-d880-46e4-86e5-f7d2e5b9b2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75999ebc-b08f-4e03-bcaa-e73976ab2e9d", "tag": "3577986f-ce4c-44d0-be2f-9e7225c86487"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:24.814733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8a6b4a75-cd1d-4ecb-aad8-98ae54b56fa5 req-58502aa3-d880-46e4-86e5-f7d2e5b9b2d1 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:24.815814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8a6b4a75-cd1d-4ecb-aad8-98ae54b56fa5 req-58502aa3-d880-46e4-86e5-f7d2e5b9b2d1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:24.816411 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-8a6b4a75-cd1d-4ecb-aad8-98ae54b56fa5 req-58502aa3-d880-46e4-86e5-f7d2e5b9b2d1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:24.831341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-8a6b4a75-cd1d-4ecb-aad8-98ae54b56fa5 req-58502aa3-d880-46e4-86e5-f7d2e5b9b2d1 service nova] Creating event network-changed:3577986f-ce4c-44d0-be2f-9e7225c86487 for instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d on hv-cinder-85528 Aug 31 07:07:24.838293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-8a6b4a75-cd1d-4ecb-aad8-98ae54b56fa5 req-58502aa3-d880-46e4-86e5-f7d2e5b9b2d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045806 Aug 31 07:07:24.839797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 382/790] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:07:24.864755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:24.875419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-34a067df-140d-432f-aef6-a669ac177cf8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.183202 Aug 31 07:07:24.876750 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 409/791] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:24 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:25.578025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:25.579183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:25.590461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:25.591369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:25.592043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:25.592843 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:25.593507 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:25.594017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:25.823049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:25.832265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:25.833984 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:25.835185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-be789b8d-96a0-473a-a1e9-11b19764b7f3 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.263348 Aug 31 07:07:25.836153 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 383/792] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:25 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:25.897188 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:25.898399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:25.907242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:25.907730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:25.908166 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:25.908866 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:25.909317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:25.909735 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:26.063745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:26.072484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2a88476b-57ba-4869-8061-17b4327abf96 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.179171 Aug 31 07:07:26.073067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 410/793] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:25 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:26.858092 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:26.858757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:26.866398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:26.866903 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:26.867708 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:26.868439 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:26.869096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:26.869714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:27.094029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:27.094590 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:27.097036 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:27.102105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:27.102589 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:27.103468 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:27.105021 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:27.106117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:27.107324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:27.133526 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:27.147158 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:27.151591 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:27.154463 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-86a2a2ac-dbdc-43e2-8ba1-7ee9267ed0b8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1739 microversion: 2.20 time: 0.298899 Aug 31 07:07:27.159023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 384/794] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:26 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:27.294111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:27.306508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ee6c0709-e95f-4498-8f21-95b8c27df910 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.216294 Aug 31 07:07:27.324416 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 411/795] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:27 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:28.183379 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:28.183975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:28.191706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.192196 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.192630 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:28.193365 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.193897 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.194295 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:28.328838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:28.330306 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:28.331668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:28.337520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.338178 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.338714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:28.339465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.339901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.340316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:28.342064 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:28.343971 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:28.345125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ed077533-ebea-426a-a335-0efb10142eab tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1721 microversion: 2.20 time: 0.167053 Aug 31 07:07:28.345760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 385/796] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:28 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:28.473872 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:28.482217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-001a6a37-d97a-434c-ac04-3861d67e6714 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.157187 Aug 31 07:07:28.482654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 412/797] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:28 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:28.842596 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:28.843206 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:28.849405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.849969 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.850468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:28.851274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.851806 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.852295 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:28.877517 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:07:28.879450 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=100 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:28.961610 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bfc1691b-5f93-48cb-8738-e9ba69cf4d78 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 204 len: 0 microversion: 2.1 time: 0.122539 Aug 31 07:07:28.962292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 386/798] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:07:28 2022] DELETE /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:07:28.970790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:28.971437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:28.977858 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.978410 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.978940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:28.979610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:28.980060 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:28.980482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:29.119870 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:29.132927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-58c360b6-1c38-413d-9083-276e28409ff4 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1577 microversion: 2.1 time: 0.165783 Aug 31 07:07:29.133803 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 413/799] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:28 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:07:29.369982 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:29.370995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:29.379088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:29.379556 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:29.379982 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:29.380682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:29.381124 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:29.381543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:29.503849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:29.504383 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:29.511674 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:29.512238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:29.512760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:29.513517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:29.514033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:29.514676 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:29.516905 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:29.525461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:29.526878 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:29.528036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-fee654b6-4de6-4865-baee-a98b03f65443 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1721 microversion: 2.20 time: 0.162885 Aug 31 07:07:29.528593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 387/800] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:29 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:29.659527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:29.668468 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-889530df-6c35-4a66-b396-5eb60b0a96c3 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.168724 Aug 31 07:07:29.669098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 414/801] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:29 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:30.160046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:30.161055 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:30.169638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:30.170126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:30.170564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:30.171316 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:30.171767 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:30.172186 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:30.311136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:30.319330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4b954a9a-1646-442e-a176-d75937f74191 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1577 microversion: 2.1 time: 0.165850 Aug 31 07:07:30.319894 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 388/802] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:30 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:30.551869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:30.552493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:30.559775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:30.560261 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:30.560694 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:30.561383 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:30.561870 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:30.562287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:30.694997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:30.695561 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:30.703131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:30.703641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:30.704054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:30.704243 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:30.704728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:30.705179 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:30.705613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:30.712557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:30.714018 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:30.715197 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-16756848-c32b-4cab-92c0-c5c96a80db9e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1721 microversion: 2.20 time: 0.167336 Aug 31 07:07:30.715749 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 415/803] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:30 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:30.842076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:30.849815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c25f535b-63af-49b7-842f-55a9f6323bf9 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.158840 Aug 31 07:07:30.850407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 389/804] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:30 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:30.911658 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-e6473e7d-716d-4299-a634-4ec1c6fd38f5 req-9703286f-d233-4942-9116-e2284d5c35b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75999ebc-b08f-4e03-bcaa-e73976ab2e9d", "name": "network-vif-plugged", "status": "completed", "tag": "3577986f-ce4c-44d0-be2f-9e7225c86487"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:30.922172 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-e6473e7d-716d-4299-a634-4ec1c6fd38f5 req-9703286f-d233-4942-9116-e2284d5c35b1 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:30.922724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-e6473e7d-716d-4299-a634-4ec1c6fd38f5 req-9703286f-d233-4942-9116-e2284d5c35b1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:30.923197 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-e6473e7d-716d-4299-a634-4ec1c6fd38f5 req-9703286f-d233-4942-9116-e2284d5c35b1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:30.927003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:30.935351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-e6473e7d-716d-4299-a634-4ec1c6fd38f5 req-9703286f-d233-4942-9116-e2284d5c35b1 service nova] Creating event network-vif-plugged:3577986f-ce4c-44d0-be2f-9e7225c86487 for instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d on hv-cinder-85528 Aug 31 07:07:30.940459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-e6473e7d-716d-4299-a634-4ec1c6fd38f5 req-9703286f-d233-4942-9116-e2284d5c35b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Aug 31 07:07:30.941052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 416/805] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:31.344772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:31.345736 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:31.349003 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:31.350107 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=6 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:31.357675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:31.358158 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:31.358590 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:31.359322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:31.359768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:31.360183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:31.506745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:31.516223 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b3518c6d-2d50-4a22-9bed-0b5339fc10cd tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1577 microversion: 2.1 time: 0.177923 Aug 31 07:07:31.516771 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 390/806] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:31 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:31.736237 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=6 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:31.741395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:31.742231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:31.750884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:31.751296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:31.751722 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:31.752416 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:31.752921 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:31.753370 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:31.872757 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:31.873484 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:31.880108 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:31.880669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:31.881605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:31.881914 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:31.882429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:31.882955 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:31.894449 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:31.903423 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:31.904910 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:31.906068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-495bebec-0586-46fe-af21-5a04a51e2d58 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1721 microversion: 2.20 time: 0.170918 Aug 31 07:07:31.906626 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 417/807] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:31 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:32.018235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:32.026462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-debb8c93-3763-41f0-9894-334faa3b1c0a tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.157628 Aug 31 07:07:32.027042 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 391/808] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:31 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:32.538194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:32.538796 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:32.545663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:32.546141 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:32.546571 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:32.547295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:32.547745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:32.548158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:32.683594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:32.691771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0d4e9351-3003-4601-8232-08ca0b0aec5b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1577 microversion: 2.1 time: 0.157635 Aug 31 07:07:32.692345 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 418/809] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:32 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:32.930674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:32.932219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:32.941421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:32.944128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:32.944128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:32.944128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:32.944540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:32.945730 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:32.960554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-fc4de979-9218-4375-810b-1b9396b41b67 req-b889f756-b132-4d9e-aae8-49067d4adda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b2fea-9e69-462c-94b4-8f6757d17252", "name": "network-vif-unplugged", "status": "completed", "tag": "32f136bd-488a-4bb2-bd5b-e40227ca99a7"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:32.975125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-fc4de979-9218-4375-810b-1b9396b41b67 req-b889f756-b132-4d9e-aae8-49067d4adda9 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:32.976050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-fc4de979-9218-4375-810b-1b9396b41b67 req-b889f756-b132-4d9e-aae8-49067d4adda9 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:32.976748 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-fc4de979-9218-4375-810b-1b9396b41b67 req-b889f756-b132-4d9e-aae8-49067d4adda9 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:32.991448 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-fc4de979-9218-4375-810b-1b9396b41b67 req-b889f756-b132-4d9e-aae8-49067d4adda9 service nova] Creating event network-vif-unplugged:32f136bd-488a-4bb2-bd5b-e40227ca99a7 for instance bf4b2fea-9e69-462c-94b4-8f6757d17252 on hv-cinder-85528 Aug 31 07:07:32.997653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-fc4de979-9218-4375-810b-1b9396b41b67 req-b889f756-b132-4d9e-aae8-49067d4adda9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040847 Aug 31 07:07:32.998614 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 419/810] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:33.050153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:33.050874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:33.058780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.059364 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.059787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.060491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.060929 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.061338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.197641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:33.206570 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-419de0d8-0e54-4986-95db-104a7f1c42a5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1366 microversion: 2.1 time: 0.160621 Aug 31 07:07:33.207777 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 420/811] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:33 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:33.278087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:33.286320 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:33.288061 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:33.289220 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-acabe063-0dd1-4a1f-bd39-9c2efcb3dfc4 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1724 microversion: 2.20 time: 0.363581 Aug 31 07:07:33.289779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 392/812] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:32 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:33.312275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5d74f20-b171-428b-9080-23259d330cda"}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:33.315014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:33.321462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.322014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.322505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.323367 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.324168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.324637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.621881 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ebaa255f-34e0-41f3-b424-0bfd1013906e tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313748 Aug 31 07:07:33.628189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 421/813] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Aug 31 07:07:33 2022] POST /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 07:07:33.713002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:33.713744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:33.720438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.720929 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.721664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.722120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.722608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.723139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.763472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:33.764099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:33.770227 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.770776 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.771300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.772051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.772592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.773073 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.832473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:33.840831 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e3c0636f-bf6d-4088-8f75-82cb4558bd6a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1509 microversion: 2.1 time: 0.131686 Aug 31 07:07:33.848144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 393/814] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:33 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1509 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:33.962307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-802d6ad5-aea2-4620-941f-1e6a783021e7 req-bce118e9-528d-4fee-8575-53c4384c3cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de723bf7-b3b4-4f94-ac57-188c9b729f30", "name": "network-vif-deleted", "tag": "9129b959-b9e7-4911-91eb-bce08274bbed"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:33.984502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-802d6ad5-aea2-4620-941f-1e6a783021e7 req-bce118e9-528d-4fee-8575-53c4384c3cf6 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:33.984984 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-802d6ad5-aea2-4620-941f-1e6a783021e7 req-bce118e9-528d-4fee-8575-53c4384c3cf6 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:33.985394 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-802d6ad5-aea2-4620-941f-1e6a783021e7 req-bce118e9-528d-4fee-8575-53c4384c3cf6 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:33.999347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-802d6ad5-aea2-4620-941f-1e6a783021e7 req-bce118e9-528d-4fee-8575-53c4384c3cf6 service nova] Creating event network-vif-deleted:9129b959-b9e7-4911-91eb-bce08274bbed for instance de723bf7-b3b4-4f94-ac57-188c9b729f30 on hv-cinder-85528 Aug 31 07:07:34.004863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-802d6ad5-aea2-4620-941f-1e6a783021e7 req-bce118e9-528d-4fee-8575-53c4384c3cf6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047842 Aug 31 07:07:34.006350 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 394/815] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:34.076117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-88232561-0e87-4349-b0e0-e662e77cb538 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-volume_attachments/b5d74f20-b171-428b-9080-23259d330cda" status: 202 len: 0 microversion: 2.20 time: 0.316667 Aug 31 07:07:34.076794 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 422/816] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Aug 31 07:07:33 2022] DELETE /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-volume_attachments/b5d74f20-b171-428b-9080-23259d330cda => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 07:07:34.148392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:34.149452 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:34.161438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.162313 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.162946 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.163851 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.164461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.165057 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.213392 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120771) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 07:07:34.235200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:34.235917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:34.242517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.243194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.243621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.244462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.244913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.245455 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.291376 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c8d7199e-7f0d-43a6-ac89-78e036083e0b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "POST /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/action" status: 202 len: 0 microversion: 2.20 time: 0.147015 Aug 31 07:07:34.292603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 395/817] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 07:07:34 2022] POST /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:07:34.301732 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:34.302344 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:34.308715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.309427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.310036 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.310944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.311570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.312147 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.458360 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:34.472624 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-55bfcb01-c885-411f-a06c-c6e47936f1fa tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1556 microversion: 2.1 time: 0.244095 Aug 31 07:07:34.483063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 423/818] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:34 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:07:34.497102 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:34.498002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:34.505839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.506628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.507385 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.520907 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.523341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.524122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.677494 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:34.681386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a2021065-94eb-47c4-be46-fb00bc4f2e09 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187732 Aug 31 07:07:34.683196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 424/819] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:07:34 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:07:34.694254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:34.697091 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:34.698378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-61f6ad8c-a5c6-4781-82a6-0e9a817ae7a2 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1672 microversion: 2.20 time: 0.400685 Aug 31 07:07:34.711114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 396/820] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:34 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1672 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:34.862342 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:34.863331 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:34.869728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.870522 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.871258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.872133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.872742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.873306 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.909647 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:34.910264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:34.910733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:34.911316 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lazy-loading 'fault' on Instance uuid de723bf7-b3b4-4f94-ac57-188c9b729f30 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:07:34.985191 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:34.993420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-84f5b13f-9ef1-4d16-8d49-65fa8980cb7f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 200 len: 1230 microversion: 2.1 time: 0.135306 Aug 31 07:07:34.994330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 425/821] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:34 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 1230 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:35.722065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:35.723564 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:35.727919 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-9c4c39b7-e868-405d-95d7-de2f7026f92f req-c37eb8c0-4e37-454b-8d60-b12032881957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75999ebc-b08f-4e03-bcaa-e73976ab2e9d", "tag": "3577986f-ce4c-44d0-be2f-9e7225c86487"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:35.730768 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:35.731501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:35.732099 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:35.733198 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:35.733810 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:35.734381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:35.747057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-9c4c39b7-e868-405d-95d7-de2f7026f92f req-c37eb8c0-4e37-454b-8d60-b12032881957 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:35.747787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-9c4c39b7-e868-405d-95d7-de2f7026f92f req-c37eb8c0-4e37-454b-8d60-b12032881957 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:35.748399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-9c4c39b7-e868-405d-95d7-de2f7026f92f req-c37eb8c0-4e37-454b-8d60-b12032881957 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:35.764106 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-9c4c39b7-e868-405d-95d7-de2f7026f92f req-c37eb8c0-4e37-454b-8d60-b12032881957 service nova] Creating event network-changed:3577986f-ce4c-44d0-be2f-9e7225c86487 for instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d on hv-cinder-85528 Aug 31 07:07:35.770633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-9c4c39b7-e868-405d-95d7-de2f7026f92f req-c37eb8c0-4e37-454b-8d60-b12032881957 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046652 Aug 31 07:07:35.771480 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 426/822] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:36.016443 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:36.017692 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:36.024043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:36.024319 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:36.025062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:36.025494 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:36.026357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:36.027226 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:36.027807 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:36.039303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:36.042493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:36.045583 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] HTTP exception thrown: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:07:36.045999 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6b4a969d-68a4-4b35-9444-3b0602034899 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.327281 Aug 31 07:07:36.046995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 397/823] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:35 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Request method failure captured: Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 HTTP/1.1 Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwe2kWEylE_x0GPsXcLJib1B5HN8xwS01LfLMRU9XHgSF0mcmLo0SC6yahnBH0ZFLkDuLDvbfE1ElW29c8ohKMRQTd2MPRZbLdhYmZsyyWpDsc9YmlLDYtu08o1dXZFZe35QY47qSwVXwrudWAkGLEKvXE72XN-rxX5YbPbQhLEQLzs Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:07:36.048059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea4b3039f2144c18b9d78267241b1a6b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-TestVolumeBootPattern-634316485 Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: dcce3144380d4577b91f3e83304f94dd Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:07:36.049633 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'de723bf7-b3b4-4f94-ac57-188c9b729f30'} Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:07:36.050498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:07:36.051936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:07:36.053856 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Returning 404 to user: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:07:36.054702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fe2ce9fd-5b2c-48cf-80c9-94f40539fc72 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 404 len: 111 microversion: 2.1 time: 0.043585 Aug 31 07:07:36.055410 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 427/824] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:36 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 07:07:36.165331 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1143227061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-370224798", "security_groups": [{"name": "tempest-secgroup-smoke-1092924035"}], "block_device_mapping_v2": [{"uuid": "6e9c8d1b-0a36-45b0-a705-3792e3ca5aaa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66ebf559-4ea4-4b90-866a-bf1d2835263f"}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:36.423294 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] validate_networks() for [('66ebf559-4ea4-4b90-866a-bf1d2835263f', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:07:37.070212 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:37.071128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:37.077984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:37.078558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:37.079147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:37.080075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:37.080592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:37.081113 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:37.155190 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:07:37.155828 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:07:37.156063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:07:37.156468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:07:37.156873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:07:37.165655 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:37.166498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:37.166959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:37.167711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:37.168158 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:37.168574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:37.185849 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:07:37.189967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for user dcce3144380d4577b91f3e83304f94dd and project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:07:37.220904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:37.229185 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:37.231411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:37.232598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-df1329a8-0144-418d-bb2b-502c464073ac tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.166955 Aug 31 07:07:37.233582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 428/825] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:37 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:37.259272 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:07:37.261681 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e9c8d1b-0a36-45b0-a705-3792e3ca5aaa',volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:07:37.364671 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:37.414129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-05c18a69-2071-444b-a6bc-aa072b2084d0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.252821 Aug 31 07:07:37.414951 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 398/826] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:07:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:07:37.426688 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b37e108b-86c0-406d-a5ba-9ff11f798dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:37.427435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b37e108b-86c0-406d-a5ba-9ff11f798dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:37.769143 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b37e108b-86c0-406d-a5ba-9ff11f798dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:37.788033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b37e108b-86c0-406d-a5ba-9ff11f798dc7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1094 microversion: 2.1 time: 0.365319 Aug 31 07:07:37.788665 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 429/827] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:37 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1094 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:38.256305 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:38.256891 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:38.263783 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:38.264273 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:38.264707 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:38.265410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:38.265860 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:38.266283 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:38.410704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:38.419974 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:38.421412 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:38.422582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c11907e8-9bae-4108-b083-3c7d4f20f4e5 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.170743 Aug 31 07:07:38.423175 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 399/828] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:38 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:38.810006 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:38.811344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:38.818490 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:38.819259 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:38.819903 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:38.820604 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:38.821216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:38.821640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:38.893218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:38.901263 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6ff56da7-4e24-414d-8e54-0b70f1d394b0 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.095372 Aug 31 07:07:38.902084 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 430/829] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:38 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:39.445788 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:39.446410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:39.453593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:39.454072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:39.454690 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:39.455420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:39.455865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:39.456282 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:39.593318 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:39.602070 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:39.603545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:39.604804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2d22c964-a3b2-4fcd-8191-29ff2bd842c6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.162896 Aug 31 07:07:39.605978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 400/830] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:39 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:39.922607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:39.923221 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:39.930432 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:39.930949 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:39.931386 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:39.932145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:39.933301 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:39.933663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:39.951632 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:40.004846 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:40.014027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-24a7200a-3cb1-4d2a-9d1c-9cd9288c9791 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.095532 Aug 31 07:07:40.014613 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 431/831] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:39 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:07:40.629580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:40.630175 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:40.637075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:40.637792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:40.638434 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:40.639332 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:40.639966 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:40.640351 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:40.784587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:40.793709 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:40.795511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:40.796683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-51b411bc-c6a4-44ec-997a-1ca20c36928c tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.171115 Aug 31 07:07:40.797237 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 401/832] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:40 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:41.035088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:41.035640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:41.042708 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:41.043229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:41.043659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:41.044359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:41.044868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:41.045306 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:41.113031 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:41.121553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ee6c5e37-aca9-44da-a61d-1d2cc09304ec tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.090502 Aug 31 07:07:41.122151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 432/833] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:41 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:41.820431 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:41.821026 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:41.831282 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:41.832065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:41.832659 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:41.833548 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:41.833996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:41.834413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:41.837558 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:41.971551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:41.980182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:41.981630 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:41.982804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-48a1b5a1-22ac-48ee-8aac-9f22f2f7d32b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.166309 Aug 31 07:07:41.983574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 402/834] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:41 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:42.142835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:42.143656 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:42.150689 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:42.151269 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:42.151782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:42.152562 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:42.153013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:42.153506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:42.222003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:42.231147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c9d869a3-4308-4926-9110-6c760ed423bc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.093101 Aug 31 07:07:42.232218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 433/835] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:42 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:43.008148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:43.008762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:43.017081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:43.017572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:43.017994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:43.018727 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:43.019265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:43.019688 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:43.161444 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:43.171062 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:43.172494 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:43.173656 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ad4c4f91-aa79-4f14-9232-c53fd2d81e4a tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.171006 Aug 31 07:07:43.174176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 403/836] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:43 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:43.251842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:43.252474 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:43.259763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:43.260249 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:43.260734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:43.261433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:43.261880 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:43.262296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:43.324651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:43.333510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1c6280f8-77f9-46a8-b3cc-a75de86447e9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.085632 Aug 31 07:07:43.334121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 434/837] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:43 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:44.198016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:44.199172 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:44.206239 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:44.206897 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:44.207447 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:44.208266 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:44.208716 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:44.209222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:44.346638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:44.353734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:44.354369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:44.359884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:44.361368 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:44.361526 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:44.361859 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:44.362288 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:44.363013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:44.363120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d97da014-654a-4168-90e4-9619d7ea3852 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.169180 Aug 31 07:07:44.363459 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:44.363950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 404/838] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:44 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:44.364066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:44.440243 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:44.448610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3ede5457-0208-4df1-87c4-40dc62aff881 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.098810 Aug 31 07:07:44.449509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 435/839] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:44 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:07:45.386871 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:45.387497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:45.394740 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:45.395284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:45.395726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:45.396460 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:45.396944 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:45.397369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:45.469003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:45.469567 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:45.476230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:45.476679 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:45.477104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:45.477793 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:45.478237 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:45.478651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:45.541893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:45.542214 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:45.550391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-951fb426-b871-4e24-81e1-1905f1b317d3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.085358 Aug 31 07:07:45.550803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:45.551203 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 436/840] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:45 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:45.559060 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:45.560311 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c7b2f201-d220-4c4f-9d0a-c4bfd4e8974d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.177716 Aug 31 07:07:45.560868 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 405/841] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:45 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:46.572178 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:46.572872 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:46.580434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:46.580932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:46.581369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:46.582072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:46.582532 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:46.582895 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:46.583362 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:46.583502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:46.590296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:46.590777 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:46.591234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:46.591929 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:46.592376 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:46.592798 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:46.647446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:46.655930 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0f5043c7-e7c3-4613-a4db-e8d4b914f5a1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1144 microversion: 2.1 time: 0.088032 Aug 31 07:07:46.656564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 437/842] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:46 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:46.728847 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:46.741498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:46.743232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:46.744930 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-84b89a79-fcfd-4cd1-b9c1-00951ca9ffd9 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.165887 Aug 31 07:07:46.745893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 406/843] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:46 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:47.678978 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:47.679549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:47.686926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:47.687648 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:47.688230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:47.689077 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:47.689674 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:47.690241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:47.755112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:47.771046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:47.772691 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c3b06801-4724-44e0-9174-2f94bb2bfbf8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1210 microversion: 2.1 time: 0.097416 Aug 31 07:07:47.773105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:47.774051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 438/844] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:47 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:47.784779 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:47.787424 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=6 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:47.791630 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:47.792421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:47.793148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:47.794683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:47.795623 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:47.796263 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:48.014825 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:48.023807 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:48.025237 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:48.026554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-63a19059-ad3d-42b8-b8ad-d3187b357f73 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.261521 Aug 31 07:07:48.027176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 407/845] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:47 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:48.797142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:48.797775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:48.799771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:48.806119 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:48.806621 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:48.807083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:48.807790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:48.808243 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:48.808660 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:48.954029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:48.962219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-51804e78-563b-4d9a-8acc-f7989cc4f19a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.169106 Aug 31 07:07:48.962877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 439/846] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:48 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:49.000085 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:49.000697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:49.007837 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:49.008528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:49.009205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:49.010153 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:49.010704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:49.011226 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:49.037399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9a859272-e232-4ccc-83aa-f82931941e9a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/ips" status: 200 len: 145 microversion: 2.1 time: 0.041149 Aug 31 07:07:49.043795 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 408/847] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:07:48 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:49.050342 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:49.051146 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:49.057644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:49.058435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:49.059089 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:49.060018 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:49.060738 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:49.061482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:49.211964 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:49.220430 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:49.221875 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:49.223075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ed388b18-db41-4e00-b9c6-8d4d59378387 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.176780 Aug 31 07:07:49.223678 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 440/848] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:49 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:49.381701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-971ce126-e51d-41af-808a-a8cb8c250c02 req-0756327f-44db-4f84-9ebf-341dfe6b1f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e827a4-116f-4f06-a229-b9cbe97a02ae", "tag": "39ec3138-7b21-430a-838a-70a49c266afd"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:49.393784 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-971ce126-e51d-41af-808a-a8cb8c250c02 req-0756327f-44db-4f84-9ebf-341dfe6b1f04 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:49.394253 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-971ce126-e51d-41af-808a-a8cb8c250c02 req-0756327f-44db-4f84-9ebf-341dfe6b1f04 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:49.395577 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-971ce126-e51d-41af-808a-a8cb8c250c02 req-0756327f-44db-4f84-9ebf-341dfe6b1f04 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:49.409106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-971ce126-e51d-41af-808a-a8cb8c250c02 req-0756327f-44db-4f84-9ebf-341dfe6b1f04 service nova] Creating event network-changed:39ec3138-7b21-430a-838a-70a49c266afd for instance 28e827a4-116f-4f06-a229-b9cbe97a02ae on hv-cinder-85528 Aug 31 07:07:49.414213 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-971ce126-e51d-41af-808a-a8cb8c250c02 req-0756327f-44db-4f84-9ebf-341dfe6b1f04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036298 Aug 31 07:07:49.414938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 409/849] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:49.983832 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:49.984409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:49.991281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:49.991763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:49.992194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:49.992884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:49.993343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:49.993762 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:50.129338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:50.137272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-17904e1e-e9a7-41c2-9d65-57ff5b06e267 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.157533 Aug 31 07:07:50.137883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 441/850] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:49 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:50.247657 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:50.250270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:50.255967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:50.256665 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:50.257105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:50.257811 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:50.258285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:50.258724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:50.466658 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:50.477156 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:50.478693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:50.479947 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b94e59a0-44fb-48bc-a5c4-7b226245abfa tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.237501 Aug 31 07:07:50.480536 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 410/851] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:50 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:51.035093 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-025188b8-bc04-41c8-ac9d-2f97a07a681f req-41b48ad4-8bf9-40c1-8444-dd8ef2aa9111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b2fea-9e69-462c-94b4-8f6757d17252", "name": "network-vif-plugged", "status": "completed", "tag": "32f136bd-488a-4bb2-bd5b-e40227ca99a7"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:51.048868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-025188b8-bc04-41c8-ac9d-2f97a07a681f req-41b48ad4-8bf9-40c1-8444-dd8ef2aa9111 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:51.049373 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-025188b8-bc04-41c8-ac9d-2f97a07a681f req-41b48ad4-8bf9-40c1-8444-dd8ef2aa9111 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:51.049785 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-025188b8-bc04-41c8-ac9d-2f97a07a681f req-41b48ad4-8bf9-40c1-8444-dd8ef2aa9111 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:51.061645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-025188b8-bc04-41c8-ac9d-2f97a07a681f req-41b48ad4-8bf9-40c1-8444-dd8ef2aa9111 service nova] Creating event network-vif-plugged:32f136bd-488a-4bb2-bd5b-e40227ca99a7 for instance bf4b2fea-9e69-462c-94b4-8f6757d17252 on hv-cinder-85528 Aug 31 07:07:51.066873 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-025188b8-bc04-41c8-ac9d-2f97a07a681f req-41b48ad4-8bf9-40c1-8444-dd8ef2aa9111 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Aug 31 07:07:51.067499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 442/852] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:51.158017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:51.158648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:51.165682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:51.166497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:51.167256 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:51.167969 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:51.168398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:51.168915 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:51.302445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:51.310599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-71f3d3cd-8bd0-411d-ba6c-2c4e554c4ec3 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.156672 Aug 31 07:07:51.311194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 411/853] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:51 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:51.506140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:51.506839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:51.513966 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:51.514491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:51.515164 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:51.516133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:51.516725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:51.517145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:51.664643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:51.673560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:51.675045 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:51.676328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-cf2312b0-f2d3-4897-a93a-c5abc81f8c27 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.174500 Aug 31 07:07:51.676929 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 443/854] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:51 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:52.335651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:52.336610 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:52.347695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:52.348544 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:52.349271 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:52.350402 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:52.351214 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:52.351916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:52.493249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:52.501219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-436d18f8-8fee-42fe-b73c-c10cb3cf9364 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.172382 Aug 31 07:07:52.501788 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 412/855] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:52 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:52.699148 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:52.699782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:52.706933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:52.707452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:52.707876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:52.708572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:52.709009 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:52.709417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:52.852027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:52.860473 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:52.861905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:52.863085 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3779ae30-0605-4a06-bb8b-e4ebb47669df tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1730 microversion: 2.20 time: 0.167830 Aug 31 07:07:52.863648 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 444/856] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:52 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:53.035599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "739ec378-aa4d-4b07-b40b-80ea616b9708"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:53.038024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:53.044560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:53.045048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:53.045484 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:53.046182 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:53.046612 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:53.047098 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:53.389975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e9ed31bc-ab3a-4fb7-846a-c1302f7d257d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358572 Aug 31 07:07:53.390648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 413/857] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:07:53 2022] POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:53.521717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:53.522320 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:53.530467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:53.530965 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:53.531404 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:53.532353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:53.532838 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:53.533333 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:53.665183 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:53.673381 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f8a66a83-2c2d-4e2c-8191-116a8c056362 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.155648 Aug 31 07:07:53.674048 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 445/858] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:53 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:53.891936 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:53.892811 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:53.899789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:53.900270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:53.900701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:53.901386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:53.901832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:53.902254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:54.046147 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:54.058154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:54.060341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:54.061961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cecabf6e-c8e8-4c45-a66f-f1bf99d238a7 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1717 microversion: 2.20 time: 0.177949 Aug 31 07:07:54.062737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 414/859] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:07:53 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:07:54.705986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:54.706596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:54.713799 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:54.714282 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:54.714718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:54.715433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:54.715878 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:54.716292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:54.878029 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:54.886343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2b920d69-2244-47be-9dd7-a7bb3d95873e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.186702 Aug 31 07:07:54.886898 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 446/860] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:54 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:55.917233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:55.917885 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:55.927486 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:55.927976 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:55.928413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:55.929111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:55.929562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:55.929986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:56.073012 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:56.081317 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5b851110-0292-4d1d-b2e3-77ceebe53255 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.169181 Aug 31 07:07:56.081882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 415/861] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:55 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:57.102078 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:57.102697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:57.109859 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:57.110347 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:57.110769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:57.111509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:57.111953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:57.112705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:57.249595 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:57.258024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-59c7badc-8778-445d-9d7b-a4b2dcdabef7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.159841 Aug 31 07:07:57.270869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 447/862] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:57 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:58.283848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:58.284934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:58.296452 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:58.297203 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:58.297863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:58.298928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:58.299865 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:58.300278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:58.444792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:58.457462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2c8cafd9-b82c-468b-bf09-fa51907f58ad tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.180453 Aug 31 07:07:58.458069 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 416/863] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:58 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:07:59.074370 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-437a29d4-7e06-4332-be0a-7e0abe4678d0 req-ce335201-24b5-4bdd-9f67-17b68d7ac501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e827a4-116f-4f06-a229-b9cbe97a02ae", "name": "network-vif-plugged", "status": "completed", "tag": "39ec3138-7b21-430a-838a-70a49c266afd"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:07:59.079924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=78 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:07:59.087218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-437a29d4-7e06-4332-be0a-7e0abe4678d0 req-ce335201-24b5-4bdd-9f67-17b68d7ac501 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:59.087690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-437a29d4-7e06-4332-be0a-7e0abe4678d0 req-ce335201-24b5-4bdd-9f67-17b68d7ac501 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:59.088246 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-437a29d4-7e06-4332-be0a-7e0abe4678d0 req-ce335201-24b5-4bdd-9f67-17b68d7ac501 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:59.101313 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-437a29d4-7e06-4332-be0a-7e0abe4678d0 req-ce335201-24b5-4bdd-9f67-17b68d7ac501 service nova] Creating event network-vif-plugged:39ec3138-7b21-430a-838a-70a49c266afd for instance 28e827a4-116f-4f06-a229-b9cbe97a02ae on hv-cinder-85528 Aug 31 07:07:59.106172 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-437a29d4-7e06-4332-be0a-7e0abe4678d0 req-ce335201-24b5-4bdd-9f67-17b68d7ac501 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035636 Aug 31 07:07:59.107039 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 448/864] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:07:59.478445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:07:59.479067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:07:59.486146 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:59.486642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:59.487116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:59.488020 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:07:59.488919 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:07:59.489350 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:07:59.620978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:07:59.631145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bfad4eee-ee79-4f09-8300-f75285e74666 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.156704 Aug 31 07:07:59.635399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 417/865] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:07:59 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:00.654012 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:00.654727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:00.662257 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:00.662733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:00.663196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:00.663910 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:00.664353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:00.664771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:00.685806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:00.840913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:00.850422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1ac59131-b9bc-4c3d-a935-432a594f873a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1266 microversion: 2.1 time: 0.200810 Aug 31 07:08:00.851050 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 449/866] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:00 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:01.004426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f48c720f-168b-46a4-94de-23cd164b1467 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:01.014968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f48c720f-168b-46a4-94de-23cd164b1467 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:01.015726 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f48c720f-168b-46a4-94de-23cd164b1467 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:01.016139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f48c720f-168b-46a4-94de-23cd164b1467 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:01.077816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:01.092714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f48c720f-168b-46a4-94de-23cd164b1467 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Going to try to stop instance {{(pid=120771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 07:08:01.140040 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f48c720f-168b-46a4-94de-23cd164b1467 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action" status: 202 len: 0 microversion: 2.1 time: 0.141726 Aug 31 07:08:01.140636 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 418/867] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:08:00 2022] POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:08:01.148960 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:01.149569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:01.155946 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:01.156483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:01.156857 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:01.157684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:01.158128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:01.158527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:01.293187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:01.303795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ae0022bd-ec7a-41df-9a13-cae88827c665 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.158671 Aug 31 07:08:01.304407 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 450/868] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:01 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:01.877175 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:01.878325 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:01.888896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:01.889703 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:01.890448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:01.891654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:01.892409 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:01.893151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:02.041016 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:02.049552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f7c68ad2-6702-48e8-aec6-2671a16652ac tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1452 microversion: 2.1 time: 0.179689 Aug 31 07:08:02.050115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 419/869] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:01 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:02.070360 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:02.070993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:02.077910 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:02.078396 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:02.078823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:02.079615 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:02.080063 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:02.080481 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:02.218632 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:02.226572 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bd112df7-7f35-4b0f-ade5-c50da00ec25b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1452 microversion: 2.1 time: 0.160378 Aug 31 07:08:02.227194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 451/870] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:02 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:02.324730 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:02.325435 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:02.331600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:02.332160 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:02.332694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:02.333385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:02.333832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:02.334261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:02.469733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:02.478539 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-06269cb5-5d5c-4c3f-a098-f12d6809cf0b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.157738 Aug 31 07:08:02.479225 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 420/871] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:02 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:03.501152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:03.502131 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:03.509525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:03.510007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:03.510499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:03.511448 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:03.511894 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:03.512318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:03.755693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:03.764139 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2e934e04-f080-48bb-a356-84ee0c1f6cbe tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.267464 Aug 31 07:08:03.764814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 452/872] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:03 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:03.931776 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-7046cc64-79e1-4331-bb9e-ad63a3ee03e5 req-8d69bd2e-e59a-4790-9c2b-e2cae7e347a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e827a4-116f-4f06-a229-b9cbe97a02ae", "tag": "39ec3138-7b21-430a-838a-70a49c266afd"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:03.942604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-7046cc64-79e1-4331-bb9e-ad63a3ee03e5 req-8d69bd2e-e59a-4790-9c2b-e2cae7e347a1 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:03.943205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-7046cc64-79e1-4331-bb9e-ad63a3ee03e5 req-8d69bd2e-e59a-4790-9c2b-e2cae7e347a1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:03.943816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-7046cc64-79e1-4331-bb9e-ad63a3ee03e5 req-8d69bd2e-e59a-4790-9c2b-e2cae7e347a1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:03.955766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-7046cc64-79e1-4331-bb9e-ad63a3ee03e5 req-8d69bd2e-e59a-4790-9c2b-e2cae7e347a1 service nova] Creating event network-changed:39ec3138-7b21-430a-838a-70a49c266afd for instance 28e827a4-116f-4f06-a229-b9cbe97a02ae on hv-cinder-85528 Aug 31 07:08:03.961060 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-7046cc64-79e1-4331-bb9e-ad63a3ee03e5 req-8d69bd2e-e59a-4790-9c2b-e2cae7e347a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033162 Aug 31 07:08:03.961875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 421/873] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:04.785812 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:04.786535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:04.793702 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:04.794185 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:04.794622 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:04.795359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:04.795814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:04.796227 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:04.926524 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:04.935365 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5dc60b84-26d0-4301-b210-e1cb5959be6d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.153607 Aug 31 07:08:04.935970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 453/874] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:04 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:05.962804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:05.963989 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:05.974199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:05.974681 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:05.975142 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:05.975834 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:05.976280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:05.976694 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:06.112474 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:06.125781 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6a4c16d7-088d-4585-b283-4e56f4e5ea0f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.170691 Aug 31 07:08:06.126607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 422/875] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:05 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:07.152478 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:07.153406 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:07.163686 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:07.164176 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:07.164609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:07.165330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:07.165782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:07.166187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:07.303799 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:07.312249 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c774b98c-b31c-47f5-bf6b-7354e7a00d09 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.166606 Aug 31 07:08:07.312822 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 454/876] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:07 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:08.336540 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:08.337287 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:08.340422 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=49 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:08.347722 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:08.348356 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:08.348898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:08.349778 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:08.350333 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:08.350898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:08.491521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:08.499809 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9fe8c271-202c-446b-9b76-bbbc96345724 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.169294 Aug 31 07:08:08.500373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 423/877] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:08 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:09.525592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:09.526516 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:09.530198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 07:08:09.530471 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Wed Aug 31 07:08:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af (ip 10.222.0.42) !!! Aug 31 07:08:09.543493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:09.543970 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:09.544406 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:09.545120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:09.545569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:09.545984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:09.683377 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:09.692135 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-890dc41a-8a73-4525-b033-36eb34825d5d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.173217 Aug 31 07:08:09.692696 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 455/878] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:09 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:10.718255 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:10.719281 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:10.730170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:10.731021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:10.731741 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:10.732872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:10.733613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:10.734323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:10.878399 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:10.888746 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-886711bd-32b3-4931-a4c8-96a9d33dceb0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.176989 Aug 31 07:08:10.889327 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 424/879] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:10 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:11.914114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:11.914936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:11.922984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:11.923554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:11.924051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:11.924863 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:11.925380 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:11.925865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:12.080719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:12.089673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2152a143-6735-4cda-a617-23c4afa17c01 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1722 microversion: 2.1 time: 0.182420 Aug 31 07:08:12.090257 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 456/880] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:11 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:13.121875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:13.122878 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:13.133521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:13.134025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:13.134454 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:13.135189 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:13.135636 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:13.136057 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:13.276018 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:13.284654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3a106e21-9133-4409-ab33-33476cde1c91 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1699 microversion: 2.1 time: 0.169471 Aug 31 07:08:13.285242 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 425/881] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:13 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1699 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:13.305594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b887c04e-9006-456a-b0a8-b5a573942f7b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:13.312666 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b887c04e-9006-456a-b0a8-b5a573942f7b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:13.313171 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b887c04e-9006-456a-b0a8-b5a573942f7b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:13.313596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b887c04e-9006-456a-b0a8-b5a573942f7b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:13.373213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b887c04e-9006-456a-b0a8-b5a573942f7b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Going to try to start instance {{(pid=120770) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 07:08:13.421441 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b887c04e-9006-456a-b0a8-b5a573942f7b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action" status: 202 len: 0 microversion: 2.1 time: 0.119252 Aug 31 07:08:13.422067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 457/882] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:08:13 2022] POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:08:13.431063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:13.431727 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:13.438021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:13.438563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:13.439108 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:13.439803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:13.440404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:13.440854 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:13.572973 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:13.584715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8e1c8b74-ca98-4e12-8627-90c790c226d5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1708 microversion: 2.1 time: 0.158409 Aug 31 07:08:13.585440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 426/883] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:13 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:14.607931 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:14.608617 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:14.615808 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:14.616283 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:14.616707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:14.617655 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:14.618089 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:14.618510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:14.758120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:14.766817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bb6458de-df7e-4288-892a-ddcf016f24ba tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1708 microversion: 2.1 time: 0.163242 Aug 31 07:08:14.767433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 458/884] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:14 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:15.789545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:15.790221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:15.798637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:15.799239 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:15.799746 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:15.800552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:15.801079 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:15.801572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:15.939873 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:15.953049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-90fd54e2-ad20-4bcf-877e-893714e178e4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1712 microversion: 2.1 time: 0.168071 Aug 31 07:08:15.953946 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 427/885] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:15 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1712 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:19.423446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:19.424005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:19.432803 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:19.433276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:19.433698 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:19.434525 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:19.435003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:19.435420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:19.460328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f50bfcd1-64d8-441e-8253-17b755002e0f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/ips" status: 200 len: 150 microversion: 2.1 time: 0.100152 Aug 31 07:08:19.460876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 459/886] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:08:19 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/ips => generated 150 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:20.814608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a14c7804-5a1e-402f-abad-804f4bad0185"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:20.817043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:20.824454 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:20.824941 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:20.825375 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:20.826076 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:20.826531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:20.826961 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:21.133204 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-638092de-7281-41d1-8279-beb1a0842a59 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "POST /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322444 Aug 31 07:08:21.133814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 428/887] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:08:20 2022] POST /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:28.825622 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:28.826239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:28.833520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:28.833941 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:28.834381 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:28.835120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:28.835578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:28.836006 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:28.924712 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lazy-loading 'services' on Instance uuid 75999ebc-b08f-4e03-bcaa-e73976ab2e9d {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:08:29.003957 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7d2ea4e9-2746-42af-a67e-3974373fc76b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments/a14c7804-5a1e-402f-abad-804f4bad0185" status: 202 len: 0 microversion: 2.1 time: 0.183692 Aug 31 07:08:29.004849 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 460/888] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:08:28 2022] DELETE /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments/a14c7804-5a1e-402f-abad-804f4bad0185 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:08:29.022483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:29.024850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:29.032492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:29.032943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:29.033400 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:29.034091 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:29.034534 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:29.034976 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:29.066413 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d18f9377-4c97-42b5-bd01-0ffffadf9efc tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 Aug 31 07:08:29.067021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 429/889] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:08:29 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:30.080537 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:30.082951 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:30.084942 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=26 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:30.090830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:30.091341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:30.091918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:30.092716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:30.093272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:30.093800 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:30.127940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3922bcf0-6377-4026-82d6-bedcf11b5440 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052536 Aug 31 07:08:30.128519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 461/890] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:08:30 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:31.145172 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:31.148695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:31.159912 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:31.160742 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:31.161459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:31.162597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:31.163402 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:31.164116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:31.168638 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:31.200165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1b50e1f9-f342-4686-ad1e-30d0d2a11b23 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061900 Aug 31 07:08:31.200729 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 430/891] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:08:31 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:08:31.264009 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:31.264771 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:31.271814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:31.272277 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:31.272701 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:31.273395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:31.273843 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:31.274264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:31.276901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:31.458522 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:08:31.537443 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ffa8511f-55fe-4391-a3c4-af871e255512 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 204 len: 0 microversion: 2.1 time: 0.277074 Aug 31 07:08:31.538225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 462/892] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:08:31 2022] DELETE /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:08:31.548432 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:31.549477 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:31.556572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:31.557049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:31.557476 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:31.558178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:31.558620 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:31.559066 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:31.700934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:31.709423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-28453830-1914-4443-ab44-01479a93cad8 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1681 microversion: 2.1 time: 0.166378 Aug 31 07:08:31.709963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 431/893] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:31 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:32.229322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:32.231560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:32.238146 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.238641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.239115 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.239804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.240252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.240668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.271176 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-41e7b472-6665-419f-9f92-5179bfdcabb0 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046266 Aug 31 07:08:32.271817 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 463/894] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 07:08:32 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:32.341172 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:32.341747 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:32.348951 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.349430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.349859 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.350626 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.351109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.351525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.385124 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:08:32.467338 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-898d2d05-7b19-4c28-be41-b55d2a054506 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 204 len: 0 microversion: 2.20 time: 0.131628 Aug 31 07:08:32.467968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 432/895] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 07:08:32 2022] DELETE /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 07:08:32.476420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:32.477027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:32.483384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.483818 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.484227 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.484912 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.485355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.485770 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.634729 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:32.644917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:32.646357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:32.647553 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-204a2e70-1ab1-4d2e-bab6-042cbe47bf79 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.175117 Aug 31 07:08:32.648088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 464/896] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:32 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:08:32.742754 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:32.743834 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:32.754647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.755488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.756212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.757370 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:32.758319 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:32.759072 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:32.917731 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:32.926529 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-078fd8f7-0f0a-424d-b3d4-d9dc5309d2d7 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1681 microversion: 2.1 time: 0.191105 Aug 31 07:08:32.927131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 433/897] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:32 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:33.670897 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:33.671466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:33.678704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:33.679203 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:33.679632 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:33.680317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:33.680758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:33.681170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:33.813790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:33.822336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:33.823798 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:33.824947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-349d6950-d535-4d24-ac03-f2a17b1b93de tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.158432 Aug 31 07:08:33.825507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 465/898] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:33 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:08:33.952674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:33.953578 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:33.960601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:33.961089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:33.961528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:33.962222 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:33.962675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:33.963135 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:34.099109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:34.107264 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ed851cc4-3f77-46d0-b118-61fa0c733598 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1681 microversion: 2.1 time: 0.161145 Aug 31 07:08:34.107835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 434/899] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:33 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:34.848736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:34.849324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:34.856131 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:34.856622 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:34.857057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:34.857760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:34.858210 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:34.858631 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:34.989638 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:34.998111 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:34.999644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:35.000975 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2c7395a7-3504-4df9-86a4-22d853522ca8 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1723 microversion: 2.20 time: 0.156744 Aug 31 07:08:35.001516 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 466/900] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:34 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:08:35.129249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:35.129839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:35.136612 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:35.137097 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:35.137529 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:35.138221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:35.138668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:35.139205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:35.764444 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:35.772773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e560c80b-cb61-436f-889d-3360d38d7b29 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1681 microversion: 2.1 time: 0.647919 Aug 31 07:08:35.773436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 435/901] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:35 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1681 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:36.025372 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:36.026062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:36.032953 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:36.033521 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:36.034046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:36.034755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:36.035216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:36.035710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:36.106945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:36.116704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:36.118406 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:36.119607 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2bbb8f71-b3fc-4672-8394-44f43201e15b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1656 microversion: 2.20 time: 0.098568 Aug 31 07:08:36.120357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 467/902] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:36 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1656 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:08:36.584525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-dd16058a-e01c-4247-b4e6-031a1fdfbb34 req-7547a13b-eb03-464e-b543-fec1bae763f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b2fea-9e69-462c-94b4-8f6757d17252", "name": "network-vif-deleted", "tag": "32f136bd-488a-4bb2-bd5b-e40227ca99a7"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:36.602968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-dd16058a-e01c-4247-b4e6-031a1fdfbb34 req-7547a13b-eb03-464e-b543-fec1bae763f1 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:36.605959 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-dd16058a-e01c-4247-b4e6-031a1fdfbb34 req-7547a13b-eb03-464e-b543-fec1bae763f1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:36.606763 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-dd16058a-e01c-4247-b4e6-031a1fdfbb34 req-7547a13b-eb03-464e-b543-fec1bae763f1 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:36.629192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-dd16058a-e01c-4247-b4e6-031a1fdfbb34 req-7547a13b-eb03-464e-b543-fec1bae763f1 service nova] Creating event network-vif-deleted:32f136bd-488a-4bb2-bd5b-e40227ca99a7 for instance bf4b2fea-9e69-462c-94b4-8f6757d17252 on hv-cinder-85528 Aug 31 07:08:36.638669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-dd16058a-e01c-4247-b4e6-031a1fdfbb34 req-7547a13b-eb03-464e-b543-fec1bae763f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061861 Aug 31 07:08:36.640882 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 436/903] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:36.796754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:36.797884 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:36.805383 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:36.806879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:36.807830 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:36.808948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:36.809644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:36.810158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:36.853292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:36.853833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:36.854262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:36.854703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lazy-loading 'fault' on Instance uuid 75999ebc-b08f-4e03-bcaa-e73976ab2e9d {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:08:36.918230 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2649ceb85846a18f4e4a3e39af712e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727ae12d19534c1db445f58beceded41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:36.930294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1eb0c541-75fb-4dc5-a0a7-6f0becd40e2c tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 200 len: 1331 microversion: 2.1 time: 0.139238 Aug 31 07:08:36.943186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 468/904] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:36 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:37.144905 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:37.145780 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:37.152403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:37.152958 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:37.153739 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:37.154723 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:37.155329 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:37.155804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:37.188597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:37.189467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:37.190126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:37.190809 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lazy-loading 'fault' on Instance uuid bf4b2fea-9e69-462c-94b4-8f6757d17252 {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:08:37.248446 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:37.258309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:37.261075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7232639661c42f59e4403c4819987d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d83c7e3bc42c0b85b360dd55bbd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:37.262421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a59e7aa2-acde-426e-a657-4abb35ccbe69 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 200 len: 1371 microversion: 2.20 time: 0.122411 Aug 31 07:08:37.263419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 437/905] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:37 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 07:08:37.956164 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:37.956820 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:37.963582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:37.964067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:37.964491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:37.965185 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:37.965635 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:37.966317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:37.980341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d HTTP/1.1 Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:37.982133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:37.983806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '75999ebc-b08f-4e03-bcaa-e73976ab2e9d'} Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:37.984754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:37.986083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:37.987842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:37.987842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3cc227f2-da25-437a-9a9a-a9facbf21242 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 404 len: 111 microversion: 2.1 time: 0.031826 Aug 31 07:08:37.987842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 469/906] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:37 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:37.993382 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ff69828d-9ea7-4e42-be61-ff241695e85f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '.version_select at 0x7ff9c06354c0>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:38.017618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ff69828d-9ea7-4e42-be61-ff241695e85f tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669934674" status: 202 len: 0 microversion: 2.1 time: 0.027864 Aug 31 07:08:38.018369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 438/907] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 31 07:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669934674 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:08:38.285181 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:38.285786 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:38.292640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:38.293124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:38.293997 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:38.294237 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:38.294709 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:38.295133 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:38.309129 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] HTTP exception thrown: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Request method failure captured: Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 HTTP/1.1 Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwc6A-WEVjXlN8JksvmpoU2SoaI89pkTkseiX91wiNBBQyjGsvNQLxIb7PKB6GyiPlFodm_59ZETMXDT-1FRhaKBkh23DKc1AcFP5xSb6Kgkh_KCrKOVmw_2NVoPhgCuYyL7njm4tUJMTBqykRE8a5C0I8VU4F7sPrtqesUJfm-Hh3k Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:38.310717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b7d83c7e3bc42c0b85b360dd55bbd5a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: c7232639661c42f59e4403c4819987d8 Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:38.312758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'bf4b2fea-9e69-462c-94b4-8f6757d17252'} Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:38.313745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:38.315028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:38.316142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Returning 404 to user: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:38.316142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6ed6d11d-9931-4bf1-8d57-306e33bcda63 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 404 len: 111 microversion: 2.20 time: 0.031207 Aug 31 07:08:38.316142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 470/908] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:38 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:38.321526 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ba21bb50-6e3b-4d85-a85d-fd6234457fb6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '.version_select at 0x7ff9c0661f70>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:38.343212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ba21bb50-6e3b-4d85-a85d-fd6234457fb6 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654564149" status: 204 len: 0 microversion: 2.20 time: 0.025435 Aug 31 07:08:38.344367 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 439/909] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Aug 31 07:08:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654564149 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 07:08:38.685916 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-792f3725-301f-467b-8a55-a735cea6df98 req-97efb764-727b-421c-abf1-f6838d549024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75999ebc-b08f-4e03-bcaa-e73976ab2e9d", "name": "network-vif-deleted", "tag": "3577986f-ce4c-44d0-be2f-9e7225c86487"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:38.696644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-792f3725-301f-467b-8a55-a735cea6df98 req-97efb764-727b-421c-abf1-f6838d549024 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:38.697103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-792f3725-301f-467b-8a55-a735cea6df98 req-97efb764-727b-421c-abf1-f6838d549024 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:38.697540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-792f3725-301f-467b-8a55-a735cea6df98 req-97efb764-727b-421c-abf1-f6838d549024 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:38.710064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-792f3725-301f-467b-8a55-a735cea6df98 req-97efb764-727b-421c-abf1-f6838d549024 service nova] Creating event network-vif-deleted:3577986f-ce4c-44d0-be2f-9e7225c86487 for instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d on hv-cinder-85528 Aug 31 07:08:38.715144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-792f3725-301f-467b-8a55-a735cea6df98 req-97efb764-727b-421c-abf1-f6838d549024 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Aug 31 07:08:38.715915 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 471/910] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:39.938199 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:39.938968 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:39.940988 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:39.947091 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:39.947684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:39.948131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:39.948844 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:39.949298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:39.949725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:39.964931 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d HTTP/1.1 Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:39.966600 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:39.968145 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '75999ebc-b08f-4e03-bcaa-e73976ab2e9d'} Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:39.969161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:39.970693 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:39.972328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:39.972328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6f76ab35-15c7-48ab-a079-2c0942766430 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 404 len: 111 microversion: 2.1 time: 0.034548 Aug 31 07:08:39.972328 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 440/911] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:08:39 2022] DELETE /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:39.982595 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:39.983446 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 75999ebc-b08f-4e03-bcaa-e73976ab2e9d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:39.990153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:39.990635 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:39.991092 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:39.991784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:39.992259 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:39.992725 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:40.006451 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d HTTP/1.1 Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:40.008122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:40.009585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '75999ebc-b08f-4e03-bcaa-e73976ab2e9d'} Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:40.010467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. Aug 31 07:08:40.011911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.013162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance 75999ebc-b08f-4e03-bcaa-e73976ab2e9d could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:40.013162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-754f5ddb-086a-42c4-b2f2-843090368a7b tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d" status: 404 len: 111 microversion: 2.1 time: 0.034919 Aug 31 07:08:40.013162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 472/912] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:39 2022] GET /compute/v2.1/servers/75999ebc-b08f-4e03-bcaa-e73976ab2e9d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:40.236735 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:40.237260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:40.243690 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:40.244171 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:40.244607 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:40.245300 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:40.245750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:40.246170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:40.261008 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] HTTP exception thrown: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Request method failure captured: Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 HTTP/1.1 Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc6A-WEVjXlN8JksvmpoU2SoaI89pkTkseiX91wiNBBQyjGsvNQLxIb7PKB6GyiPlFodm_59ZETMXDT-1FRhaKBkh23DKc1AcFP5xSb6Kgkh_KCrKOVmw_2NVoPhgCuYyL7njm4tUJMTBqykRE8a5C0I8VU4F7sPrtqesUJfm-Hh3k Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:40.262599 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b7d83c7e3bc42c0b85b360dd55bbd5a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: c7232639661c42f59e4403c4819987d8 Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.264219 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'bf4b2fea-9e69-462c-94b4-8f6757d17252'} Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:40.265111 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.266812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.268260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Returning 404 to user: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:40.268260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-809d0bf6-baf2-4367-98c2-0a0ccb726f47 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 404 len: 111 microversion: 2.20 time: 0.031750 Aug 31 07:08:40.268260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 441/913] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 07:08:40 2022] DELETE /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:40.273092 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:40.273703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: bf4b2fea-9e69-462c-94b4-8f6757d17252] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:40.280145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:40.280630 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:40.281145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:40.282335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:40.282789 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:40.283242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:40.297790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] HTTP exception thrown: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Request method failure captured: Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 HTTP/1.1 Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwc6A-WEVjXlN8JksvmpoU2SoaI89pkTkseiX91wiNBBQyjGsvNQLxIb7PKB6GyiPlFodm_59ZETMXDT-1FRhaKBkh23DKc1AcFP5xSb6Kgkh_KCrKOVmw_2NVoPhgCuYyL7njm4tUJMTBqykRE8a5C0I8VU4F7sPrtqesUJfm-Hh3k Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:40.299399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b7d83c7e3bc42c0b85b360dd55bbd5a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: c7232639661c42f59e4403c4819987d8 Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.301071 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'bf4b2fea-9e69-462c-94b4-8f6757d17252'} Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:40.302062 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. Aug 31 07:08:40.303645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:40.305150 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Returning 404 to user: Instance bf4b2fea-9e69-462c-94b4-8f6757d17252 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:40.305150 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a3372fb4-3144-4026-be9f-bbb55344452b tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252" status: 404 len: 111 microversion: 2.20 time: 0.031796 Aug 31 07:08:40.305150 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 473/914] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:40 2022] GET /compute/v2.1/servers/bf4b2fea-9e69-462c-94b4-8f6757d17252 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:41.157838 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:41.158514 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:41.165788 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.166273 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.167054 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.167792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.168241 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.168654 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.182745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 HTTP/1.1 Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:41.184336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.185808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'c60c403d-4631-4546-b33b-2c834c278fc1'} Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:41.186624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.188349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.190627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:41.190627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-81f1e85e-98e8-499b-bba8-7cacb747e228 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 404 len: 111 microversion: 2.1 time: 0.032132 Aug 31 07:08:41.190627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 442/915] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:08:41 2022] DELETE /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:41.195140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:41.196025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c60c403d-4631-4546-b33b-2c834c278fc1] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:41.204862 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.205339 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.205764 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.206539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.207012 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.207434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.222646 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 HTTP/1.1 Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:41.224190 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.225724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'c60c403d-4631-4546-b33b-2c834c278fc1'} Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:41.226918 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. Aug 31 07:08:41.229258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.231860 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance c60c403d-4631-4546-b33b-2c834c278fc1 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:41.231860 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f9f5d6c3-e82f-4a1d-86ff-885320cf36df tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1" status: 404 len: 111 microversion: 2.1 time: 0.034735 Aug 31 07:08:41.231860 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 474/916] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:41 2022] GET /compute/v2.1/servers/c60c403d-4631-4546-b33b-2c834c278fc1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:41.238824 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:41.239531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:41.249469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.250183 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.250622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.251387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.251842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.252269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.265936 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 HTTP/1.1 Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:41.267706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.269154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '336cfa5e-6e07-45f0-af84-07847284d723'} Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:41.270037 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.271497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.272963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:41.272963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5ba80a30-cc67-4475-8cfa-0a613c07312d tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 404 len: 111 microversion: 2.1 time: 0.035871 Aug 31 07:08:41.272963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 443/917] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:08:41 2022] DELETE /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:41.278112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:41.278726 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: 336cfa5e-6e07-45f0-af84-07847284d723] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:41.285497 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.285983 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.286422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.287157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.287609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.288033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.302277 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 HTTP/1.1 Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:41.303867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.305322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '336cfa5e-6e07-45f0-af84-07847284d723'} Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:41.306195 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. Aug 31 07:08:41.307699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.309310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance 336cfa5e-6e07-45f0-af84-07847284d723 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:41.309310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ef91655d-0d73-4124-b05f-744e61b1af38 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723" status: 404 len: 111 microversion: 2.1 time: 0.031058 Aug 31 07:08:41.309310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 475/918] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:41 2022] GET /compute/v2.1/servers/336cfa5e-6e07-45f0-af84-07847284d723 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 07:08:41.451299 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:41.451872 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:41.458245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.458733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.459208 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.459901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.460350 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.460771 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.474572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] HTTP exception thrown: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Request method failure captured: Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b HTTP/1.1 Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwc6A-WEVjXlN8JksvmpoU2SoaI89pkTkseiX91wiNBBQyjGsvNQLxIb7PKB6GyiPlFodm_59ZETMXDT-1FRhaKBkh23DKc1AcFP5xSb6Kgkh_KCrKOVmw_2NVoPhgCuYyL7njm4tUJMTBqykRE8a5C0I8VU4F7sPrtqesUJfm-Hh3k Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:41.476164 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b7d83c7e3bc42c0b85b360dd55bbd5a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: c7232639661c42f59e4403c4819987d8 Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.477760 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '511f1298-6885-4659-86c4-2bb83fa7803b'} Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:41.478560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.479787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.481116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Returning 404 to user: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:41.481116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-25087578-ab6c-474e-a844-e657f4f6de9d tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "DELETE /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 404 len: 111 microversion: 2.20 time: 0.030248 Aug 31 07:08:41.481116 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 444/919] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 07:08:41 2022] DELETE /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:41.487137 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:41.487746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] [instance: 511f1298-6885-4659-86c4-2bb83fa7803b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:41.494203 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.494693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.495168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.495867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:41.496318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:41.496743 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:41.513799 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] HTTP exception thrown: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Request method failure captured: Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b HTTP/1.1 Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwc6A-WEVjXlN8JksvmpoU2SoaI89pkTkseiX91wiNBBQyjGsvNQLxIb7PKB6GyiPlFodm_59ZETMXDT-1FRhaKBkh23DKc1AcFP5xSb6Kgkh_KCrKOVmw_2NVoPhgCuYyL7njm4tUJMTBqykRE8a5C0I8VU4F7sPrtqesUJfm-Hh3k Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:41.515506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b7d83c7e3bc42c0b85b360dd55bbd5a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b7d83c7e3bc42c0b85b360dd55bbd5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 3b7d83c7e3bc42c0b85b360dd55bbd5a Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1049948412 Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: c7232639661c42f59e4403c4819987d8 Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1049948412-project Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.517906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '511f1298-6885-4659-86c4-2bb83fa7803b'} Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:41.518769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. Aug 31 07:08:41.520489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:41.521791 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] Returning 404 to user: Instance 511f1298-6885-4659-86c4-2bb83fa7803b could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:41.521791 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-e760fc24-cb22-41f2-8916-f1cb29e55620 tempest-AttachVolumeShelveTestJSON-1049948412 tempest-AttachVolumeShelveTestJSON-1049948412-project] 10.222.0.42 "GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b" status: 404 len: 111 microversion: 2.20 time: 0.035161 Aug 31 07:08:41.521791 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 476/920] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 07:08:41 2022] GET /compute/v2.1/servers/511f1298-6885-4659-86c4-2bb83fa7803b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:42.464518 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:42.465077 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:42.471598 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:42.472046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:42.472498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:42.473189 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:42.473631 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:42.474048 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:42.489896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 HTTP/1.1 Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:42.491396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.493017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'c90e4773-c53c-4ed4-b224-f6763afc33d9'} Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:42.493901 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.495387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.496852 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:42.496852 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d0fafc9b-cb32-4c2c-88a4-4cfad64732e5 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 404 len: 111 microversion: 2.1 time: 0.032224 Aug 31 07:08:42.497035 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 445/921] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:08:42 2022] DELETE /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:42.502431 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:42.503357 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] [instance: c90e4773-c53c-4ed4-b224-f6763afc33d9] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:42.509852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:42.510200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:42.510625 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:42.511378 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:42.511822 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:42.512264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:42.526519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] HTTP exception thrown: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Request method failure captured: Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 HTTP/1.1 Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDweM9hEl13aiLfFYbqWJpJvJwLefE03vSQUkVvaMSn_oMEjGHWBuxM85X4Y_N3oY-lr9CoVJ41ljNE7H2n6aNcakXInxqbuxeI6wm9CJROORZZmhvrZumy7F_wvNMOkr2S_rBFHfT0fgRlQUQ6Wi4MSaH7CXeHUjpIkmOKznI1SOP-I Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:42.528066 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/727ae12d19534c1db445f58beceded41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_727ae12d19534c1db445f58beceded41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/727ae12d19534c1db445f58beceded41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 727ae12d19534c1db445f58beceded41 Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-359581149 Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: 7a2649ceb85846a18f4e4a3e39af712e Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeNegativeTest-359581149-project Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.529662 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'c90e4773-c53c-4ed4-b224-f6763afc33d9'} Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:42.530540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. Aug 31 07:08:42.532265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:42.533720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] Returning 404 to user: Instance c90e4773-c53c-4ed4-b224-f6763afc33d9 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:42.533720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-9e5b109d-a8e2-4031-9cd7-8325a252c671 tempest-AttachVolumeNegativeTest-359581149 tempest-AttachVolumeNegativeTest-359581149-project] 10.222.0.42 "GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9" status: 404 len: 111 microversion: 2.1 time: 0.031169 Aug 31 07:08:42.533720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 477/922] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:42 2022] GET /compute/v2.1/servers/c90e4773-c53c-4ed4-b224-f6763afc33d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:47.825991 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-de344179-72e9-4d8e-9008-153b1ec2eb40 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Action: 'create', calling method: .version_select at 0x7ff9c0608820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1602489000", "metadata": {"Type": "work"}}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-de344179-72e9-4d8e-9008-153b1ec2eb40 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Request method failure captured: Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 122 Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwj_Akk7Kk2gTOmSKloxfwYNg_CfHmiNUDU682uSVRvdWqXaXCL3mL4p4Y4d30bnuHBSAlOTpam-YiYPNE1QFJ7QRb7MMgp6tBZh8lDGtkavJ90wxZX6crXNTrdUNuOuo9Bo3Hk8lfYtosHYggCJ0HF-BbGPofshLhCK6eCU5bc-AZY Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:47.839157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/12d8719592734f30ab0c850ed6563842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_12d8719592734f30ab0c850ed6563842", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: cbb69504ebbf4e2ea7c13ecb906c3e36 Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1602489000", "metadata": {"Type": "work"}}} Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: Aug 31 07:08:47.840706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1602489000', 'metadata': {'Type': 'work'}}}} Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise error Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:47.841635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 07:08:47.843876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 07:08:47.846761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 07:08:47.846761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.846761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-de344179-72e9-4d8e-9008-153b1ec2eb40 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:47.846761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-de344179-72e9-4d8e-9008-153b1ec2eb40 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131483 Aug 31 07:08:47.846761 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 446/923] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 07:08:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:47.851226 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-08da213d-620e-4411-89a0-99ea379fe42e tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Action: 'create', calling method: .version_select at 0x7ff9c05d0af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1642571025", "metadata": {"Type": "work"}}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-08da213d-620e-4411-89a0-99ea379fe42e tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Request method failure captured: Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 120 Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwj_Akk7Kk2gTOmSKloxfwYNg_CfHmiNUDU682uSVRvdWqXaXCL3mL4p4Y4d30bnuHBSAlOTpam-YiYPNE1QFJ7QRb7MMgp6tBZh8lDGtkavJ90wxZX6crXNTrdUNuOuo9Bo3Hk8lfYtosHYggCJ0HF-BbGPofshLhCK6eCU5bc-AZY Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:47.856177 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/12d8719592734f30ab0c850ed6563842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_12d8719592734f30ab0c850ed6563842", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: cbb69504ebbf4e2ea7c13ecb906c3e36 Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1642571025", "metadata": {"Type": "work"}}} Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: Aug 31 07:08:47.857746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1642571025', 'metadata': {'Type': 'work'}}}} Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise error Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi '0' Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:47.859122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 07:08:47.860605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 07:08:47.861721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 07:08:47.861721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.861721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-08da213d-620e-4411-89a0-99ea379fe42e tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:47.861721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-08da213d-620e-4411-89a0-99ea379fe42e tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010757 Aug 31 07:08:47.861721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 478/924] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 07:08:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:47.869557 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5db3599d-3b2a-409d-a8fd-cbabf0b44bbb tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Action: 'create', calling method: .version_select at 0x7ff9c068ed30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1224423310", "metadata": {"Type": "work"}}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5db3599d-3b2a-409d-a8fd-cbabf0b44bbb tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Request method failure captured: Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 119 Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwj_Akk7Kk2gTOmSKloxfwYNg_CfHmiNUDU682uSVRvdWqXaXCL3mL4p4Y4d30bnuHBSAlOTpam-YiYPNE1QFJ7QRb7MMgp6tBZh8lDGtkavJ90wxZX6crXNTrdUNuOuo9Bo3Hk8lfYtosHYggCJ0HF-BbGPofshLhCK6eCU5bc-AZY Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:47.873279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/12d8719592734f30ab0c850ed6563842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_12d8719592734f30ab0c850ed6563842", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: cbb69504ebbf4e2ea7c13ecb906c3e36 Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1224423310", "metadata": {"Type": "work"}}} Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: Aug 31 07:08:47.874917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1224423310', 'metadata': {'Type': 'work'}}}} Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise error Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi '' Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:47.876133 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 07:08:47.877488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 07:08:47.878697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 07:08:47.878697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.878697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5db3599d-3b2a-409d-a8fd-cbabf0b44bbb tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:47.878697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5db3599d-3b2a-409d-a8fd-cbabf0b44bbb tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010170 Aug 31 07:08:47.878697 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 447/925] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 07:08:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 07:08:47.885033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-13c75c3a-2be6-42dc-a8ee-e01dd5f6d321 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Calling method '.version_select at 0x7ff9c05633a0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:47.917556 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-13c75c3a-2be6-42dc-a8ee-e01dd5f6d321 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] HTTP exception thrown: Volume tempest-invalid-840794673 could not be found. Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-13c75c3a-2be6-42dc-a8ee-e01dd5f6d321 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Request method failure captured: Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-840794673 HTTP/1.1 Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwj_Akk7Kk2gTOmSKloxfwYNg_CfHmiNUDU682uSVRvdWqXaXCL3mL4p4Y4d30bnuHBSAlOTpam-YiYPNE1QFJ7QRb7MMgp6tBZh8lDGtkavJ90wxZX6crXNTrdUNuOuo9Bo3Hk8lfYtosHYggCJ0HF-BbGPofshLhCK6eCU5bc-AZY Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:47.919683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/12d8719592734f30ab0c850ed6563842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_12d8719592734f30ab0c850ed6563842", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: cbb69504ebbf4e2ea7c13ecb906c3e36 Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Volume tempest-invalid-840794673 could not be found. Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'tempest-invalid-840794673'} Aug 31 07:08:47.921355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-840794673 could not be found. (HTTP 404) (Request-ID: req-fabff4e3-94a2-4e88-813e-65cedb0684f4) Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.922239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 07:08:47.924072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-840794673 could not be found. Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:47.925864 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-840794673 could not be found. Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-840794673 could not be found. Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-13c75c3a-2be6-42dc-a8ee-e01dd5f6d321 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Returning 404 to user: Volume tempest-invalid-840794673 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-13c75c3a-2be6-42dc-a8ee-e01dd5f6d321 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-840794673" status: 404 len: 98 microversion: 2.1 time: 0.040493 Aug 31 07:08:47.927308 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 479/926] 10.222.0.42 () {58 vars in 1215 bytes} [Wed Aug 31 07:08:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-840794673 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 07:08:47.934312 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-17cfdb27-8cc6-4f89-af47-dbaf1800bd55 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003785 Aug 31 07:08:47.934809 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 448/927] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 31 07:08:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 07:08:47.944351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4bf6491d-ddf6-4bc5-9f9b-72fb5a4a8b0e tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003755 Aug 31 07:08:47.944839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 480/928] 10.222.0.42 () {58 vars in 1137 bytes} [Wed Aug 31 07:08:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 07:08:47.953523 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ec927d69-2bf4-4406-9ab5-c82bacb1dccc tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Calling method '.version_select at 0x7ff9c05f7ca0>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:47.982448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-ec927d69-2bf4-4406-9ab5-c82bacb1dccc tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] HTTP exception thrown: Volume cdb8965a-413e-453f-a309-40adaa6238a0 could not be found. Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ec927d69-2bf4-4406-9ab5-c82bacb1dccc tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Request method failure captured: Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/os-volumes/cdb8965a-413e-453f-a309-40adaa6238a0 HTTP/1.1 Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwj_Akk7Kk2gTOmSKloxfwYNg_CfHmiNUDU682uSVRvdWqXaXCL3mL4p4Y4d30bnuHBSAlOTpam-YiYPNE1QFJ7QRb7MMgp6tBZh8lDGtkavJ90wxZX6crXNTrdUNuOuo9Bo3Hk8lfYtosHYggCJ0HF-BbGPofshLhCK6eCU5bc-AZY Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:08:47.986176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/12d8719592734f30ab0c850ed6563842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_12d8719592734f30ab0c850ed6563842", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: cbb69504ebbf4e2ea7c13ecb906c3e36 Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Volume cdb8965a-413e-453f-a309-40adaa6238a0 could not be found. Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'cdb8965a-413e-453f-a309-40adaa6238a0'} Aug 31 07:08:47.988302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cdb8965a-413e-453f-a309-40adaa6238a0 could not be found. (HTTP 404) (Request-ID: req-c3cf6708-90c7-4bed-9122-c4ddbc7f5af4) Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.989884 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 07:08:47.991943 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cdb8965a-413e-453f-a309-40adaa6238a0 could not be found. Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 07:08:47.994045 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cdb8965a-413e-453f-a309-40adaa6238a0 could not be found. Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cdb8965a-413e-453f-a309-40adaa6238a0 could not be found. Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ec927d69-2bf4-4406-9ab5-c82bacb1dccc tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Returning 404 to user: Volume cdb8965a-413e-453f-a309-40adaa6238a0 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ec927d69-2bf4-4406-9ab5-c82bacb1dccc tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/cdb8965a-413e-453f-a309-40adaa6238a0" status: 404 len: 109 microversion: 2.1 time: 0.038068 Aug 31 07:08:47.995459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 449/929] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:08:47 2022] DELETE /compute/v2.1/os-volumes/cdb8965a-413e-453f-a309-40adaa6238a0 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:47.997426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d1084942-a777-4f44-a2a8-cec0228f0097 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Calling method '.version_select at 0x7ff9c059db80>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:48.025098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-d1084942-a777-4f44-a2a8-cec0228f0097 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] HTTP exception thrown: Volume 3c9799a9-c93d-4829-be5c-4113ac172b2e could not be found. Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d1084942-a777-4f44-a2a8-cec0228f0097 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Request method failure captured: Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/os-volumes/3c9799a9-c93d-4829-be5c-4113ac172b2e HTTP/1.1 Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwj_Akk7Kk2gTOmSKloxfwYNg_CfHmiNUDU682uSVRvdWqXaXCL3mL4p4Y4d30bnuHBSAlOTpam-YiYPNE1QFJ7QRb7MMgp6tBZh8lDGtkavJ90wxZX6crXNTrdUNuOuo9Bo3Hk8lfYtosHYggCJ0HF-BbGPofshLhCK6eCU5bc-AZY Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:08:48.027926 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/12d8719592734f30ab0c850ed6563842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_12d8719592734f30ab0c850ed6563842", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/12d8719592734f30ab0c850ed6563842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 12d8719592734f30ab0c850ed6563842 Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesNegativeTest-360611650 Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: cbb69504ebbf4e2ea7c13ecb906c3e36 Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesNegativeTest-360611650-project Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Volume 3c9799a9-c93d-4829-be5c-4113ac172b2e could not be found. Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '3c9799a9-c93d-4829-be5c-4113ac172b2e'} Aug 31 07:08:48.029598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c9799a9-c93d-4829-be5c-4113ac172b2e could not be found. (HTTP 404) (Request-ID: req-c8f91390-498a-415f-a443-ca8af7d65fe0) Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:48.030506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:08:48.032028 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c9799a9-c93d-4829-be5c-4113ac172b2e could not be found. Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 07:08:48.033673 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c9799a9-c93d-4829-be5c-4113ac172b2e could not be found. Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c9799a9-c93d-4829-be5c-4113ac172b2e could not be found. Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d1084942-a777-4f44-a2a8-cec0228f0097 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] Returning 404 to user: Volume 3c9799a9-c93d-4829-be5c-4113ac172b2e could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d1084942-a777-4f44-a2a8-cec0228f0097 tempest-VolumesNegativeTest-360611650 tempest-VolumesNegativeTest-360611650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3c9799a9-c93d-4829-be5c-4113ac172b2e" status: 404 len: 109 microversion: 2.1 time: 0.035711 Aug 31 07:08:48.035079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 481/930] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:08:47 2022] GET /compute/v2.1/os-volumes/3c9799a9-c93d-4829-be5c-4113ac172b2e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:08:48.333653 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-aa22a87b-c728-4433-bef9-d23286c6b191 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c068ed30>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:48.380804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-aa22a87b-c728-4433-bef9-d23286c6b191 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5b9f92a2-7237-4980-a295-bc3a0b0f7c41" status: 200 len: 351 microversion: 2.1 time: 0.050883 Aug 31 07:08:48.381369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 450/931] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:08:48 2022] GET /compute/v2.1/os-volumes/5b9f92a2-7237-4980-a295-bc3a0b0f7c41 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:49.726328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c6968d08-b517-484c-91c7-762ca09b0cdf tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c059dca0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:49.779388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c6968d08-b517-484c-91c7-762ca09b0cdf tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7fb41aba-6f3c-4353-8cef-d37769f4f6e3" status: 200 len: 350 microversion: 2.1 time: 0.059159 Aug 31 07:08:49.780008 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 482/932] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:08:49 2022] GET /compute/v2.1/os-volumes/7fb41aba-6f3c-4353-8cef-d37769f4f6e3 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:51.116989 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.117508 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:51.123982 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:51.124464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:51.124895 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:51.125582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:51.126095 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:51.126532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:51.132601 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-24869679-34d4-4ca5-9280-f461025b8c9f tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c05d0af0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.181153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-24869679-34d4-4ca5-9280-f461025b8c9f tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c5a22753-5b06-4ff2-b6de-07f00750f9ff" status: 200 len: 350 microversion: 2.1 time: 0.053002 Aug 31 07:08:51.181912 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 483/933] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes/c5a22753-5b06-4ff2-b6de-07f00750f9ff => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:08:51.194293 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b73f822b-27eb-4a18-bbdb-0020eeb6fd9d tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c056fee0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.214632 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lazy-loading 'services' on Instance uuid 7580179a-eac1-45f0-ab8f-0bb0572699af {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:08:51.276937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b73f822b-27eb-4a18-bbdb-0020eeb6fd9d tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086230 Aug 31 07:08:51.277769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 484/934] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:51.287241 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-05f50138-f62f-4658-b84d-2d1eda5af94e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-volume_attachments/739ec378-aa4d-4b07-b40b-80ea616b9708" status: 202 len: 0 microversion: 2.1 time: 0.174674 Aug 31 07:08:51.287967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 451/935] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:08:51 2022] DELETE /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-volume_attachments/739ec378-aa4d-4b07-b40b-80ea616b9708 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:08:51.291675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-085354f1-e1db-4556-a2c7-be783f17a59f tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c05b8d30>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.382585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-085354f1-e1db-4556-a2c7-be783f17a59f tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094733 Aug 31 07:08:51.383201 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 485/936] 10.222.0.42 () {58 vars in 1149 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:08:51.397867 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-957164ab-b5f5-41b1-ba47-521204c924c4 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c05f7f70>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.490261 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-957164ab-b5f5-41b1-ba47-521204c924c4 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.096862 Aug 31 07:08:51.490833 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 452/937] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:51.503942 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-41b1292f-f5e3-44e1-b702-cc9f23024c06 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c056fee0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.587861 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-41b1292f-f5e3-44e1-b702-cc9f23024c06 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088209 Aug 31 07:08:51.588431 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 486/938] 10.222.0.42 () {58 vars in 1167 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:08:51.602821 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6db4a9e8-c326-44b8-a46f-6414bc9e9966 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c076b790>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.690741 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6db4a9e8-c326-44b8-a46f-6414bc9e9966 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088440 Aug 31 07:08:51.691117 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 453/939] 10.222.0.42 () {58 vars in 1170 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:51.704585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-fd477b3f-19d5-4421-b8d0-80842df850c9 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c059dca0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.793908 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-fd477b3f-19d5-4421-b8d0-80842df850c9 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093040 Aug 31 07:08:51.794493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 487/940] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:51.808214 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a73246e9-945f-4612-8ac9-e6042f2a4bb0 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c068eee0>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:51.897850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a73246e9-945f-4612-8ac9-e6042f2a4bb0 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093423 Aug 31 07:08:51.898427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 454/941] 10.222.0.42 () {58 vars in 1188 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:08:51.914156 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0f49da2c-bc3d-45c3-b2f2-4a62c4226061 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] Calling method '.version_select at 0x7ff9c061f940>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:52.000822 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0f49da2c-bc3d-45c3-b2f2-4a62c4226061 tempest-VolumesTestJSON-17095796 tempest-VolumesTestJSON-17095796-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090373 Aug 31 07:08:52.001405 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 488/942] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 31 07:08:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:55.624240 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-33570144-b537-4137-9e9a-ae8a0abca37c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:08:55.631584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33570144-b537-4137-9e9a-ae8a0abca37c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:55.632071 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33570144-b537-4137-9e9a-ae8a0abca37c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:55.632593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-33570144-b537-4137-9e9a-ae8a0abca37c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:55.654708 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-33570144-b537-4137-9e9a-ae8a0abca37c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Going to try to stop instance {{(pid=120771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 07:08:55.701519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-33570144-b537-4137-9e9a-ae8a0abca37c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action" status: 202 len: 0 microversion: 2.1 time: 0.081641 Aug 31 07:08:55.702466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 455/943] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:08:55 2022] POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:08:55.708249 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:55.709072 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:55.713529 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:55.714149 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:55.723508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:55.724005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:55.724512 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:55.725216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:55.725697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:55.726108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:55.865848 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:55.873973 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7b796b67-ea53-418a-b378-769af46e8c77 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.167058 Aug 31 07:08:55.874554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 489/944] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:55 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:56.900790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:56.901902 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:56.913204 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:56.913680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:56.914119 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:56.914820 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:56.915298 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:56.915744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:57.055918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:57.063973 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2c3f0fe9-730c-42b1-8572-6d6cacc73dd9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.170441 Aug 31 07:08:57.064562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 456/945] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:56 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:58.087917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:58.088574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:58.097584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:58.098191 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:58.098768 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:58.099708 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:58.100306 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:58.100856 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:58.242001 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:58.250484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1bea6fc6-49bf-4ed2-80b6-e8a60054c381 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.168086 Aug 31 07:08:58.251095 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 490/946] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:58 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:08:59.273277 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:08:59.274005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:08:59.281039 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:59.281521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:59.281951 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:59.282641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:08:59.283130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:08:59.283552 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:08:59.417449 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:08:59.419815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:08:59.426996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ce122185-91d9-4333-82f3-60356212f229 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.158099 Aug 31 07:08:59.427570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 457/947] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:08:59 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:00.449937 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:00.450697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:00.457163 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:00.457642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:00.458074 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:00.467569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:00.468081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:00.468515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:00.609216 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:00.617644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-51b1608e-0293-43c9-a1dd-24734abb51a4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.172458 Aug 31 07:09:00.618194 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 491/948] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:00 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:01.639570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:01.640346 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:01.648772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:01.649467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:01.649986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:01.650820 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:01.651525 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:01.652059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:01.817347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:01.827773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dde8121b-69de-46df-86eb-3c03c2e263f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.192424 Aug 31 07:09:01.828711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 458/949] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:01 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:02.850680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:02.851396 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:02.858435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:02.858943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:02.859371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:02.860054 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:02.860498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:02.860911 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:02.990707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:02.999600 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-11381485-f3d4-4a2a-bf58-53fb40ed1672 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.152807 Aug 31 07:09:03.000140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 492/950] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:02 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:04.023924 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:04.024532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:04.031797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:04.032248 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:04.032684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:04.033377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:04.033823 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:04.034244 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:04.176237 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:04.184550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c9523cad-3371-400c-96eb-698cc85be85b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.166927 Aug 31 07:09:04.185126 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 459/951] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:04 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:05.207873 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:05.208507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:05.215865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:05.216358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:05.216806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:05.217498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:05.217968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:05.218375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:05.355708 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:05.364341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8ddf3626-5268-4cdf-9523-2d92b0f6dac0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.160445 Aug 31 07:09:05.364906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 493/952] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:05 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:06.391211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:06.391862 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:06.399744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:06.400340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:06.400880 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:06.401733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:06.402285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:06.403142 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:06.541604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:06.550275 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ffaf271f-0388-4255-89de-7d12418de9c0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.165124 Aug 31 07:09:06.550922 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 460/953] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:06 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:07.575235 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:07.576290 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:07.587326 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:07.588108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:07.588843 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:07.589983 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:07.590597 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:07.591014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:07.727047 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:07.734986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7d5a4372-7e6b-4a2c-84f8-bf75e25eb729 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.166310 Aug 31 07:09:07.735574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 494/954] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:07 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:08.761440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:08.762973 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:08.769801 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:08.770282 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:08.770728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:08.771457 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:08.771909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:08.772334 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:08.904478 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:08.912862 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0ef0f3d5-5898-4f8c-bab6-37d8bd975683 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.158914 Aug 31 07:09:08.913429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 461/955] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:08 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:09.934510 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:09.935267 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:09.947120 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:09.947825 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:09.948261 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:09.949004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:09.949449 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:09.949939 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:10.094655 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:10.102642 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bc32b437-ed00-4927-a5a7-64eddd6365c6 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.172147 Aug 31 07:09:10.103584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 495/956] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:09 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:11.126816 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:11.127576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:11.130319 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=28 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:09:11.136806 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:11.137379 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:11.137892 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:11.138725 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:11.139285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:11.139990 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:11.286402 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:11.295310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b921a2f8-9a47-453d-b820-5bb975d6b3b2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.173870 Aug 31 07:09:11.295957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 462/957] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:11 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:12.321604 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:12.322604 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:12.332931 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:12.333734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:12.334455 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:12.335636 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:12.336395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:12.337092 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:12.477998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:12.489193 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4d571cf3-4e3a-4f27-adb4-155d95ee94b3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.174290 Aug 31 07:09:12.489866 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 496/958] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:12 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:13.517645 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:13.518214 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:13.525458 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:13.525947 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:13.526383 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:13.527131 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:13.527584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:13.528011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:13.661752 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:13.670221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-5106e5f8-002c-4ffe-be9c-787ad299e642 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.158824 Aug 31 07:09:13.670810 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 463/959] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:13 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:14.693469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:14.694075 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:14.701171 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:14.701663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:14.702098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:14.702790 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:14.703328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:14.703664 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:14.837634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:14.848225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0df54cb6-8a26-4c40-aaf5-94d16e647d12 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.158958 Aug 31 07:09:14.848834 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 497/960] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:14 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:15.877839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:15.878414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:15.885418 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:15.885899 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:15.886342 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:15.887083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:15.887537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:15.887963 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:16.038120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:16.051059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d7dd2e48-0146-4a3f-8085-1901b2d78e9d tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.179417 Aug 31 07:09:16.051740 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 464/961] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:15 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:17.081401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:17.082087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:17.091292 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:17.091923 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:17.092462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:17.093485 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:17.094162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:17.094769 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:17.238999 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:17.247221 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-17366e86-88f7-40e5-bb1e-0a630e323c2e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1676 microversion: 2.1 time: 0.172344 Aug 31 07:09:17.247782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 498/962] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:17 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:18.268291 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:18.269052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:18.276651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:18.277455 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:18.277893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:18.278601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:18.279092 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:18.279516 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:18.421938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:18.431464 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ff9dcdc8-8022-4ed9-bee5-e4940b3cb572 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1653 microversion: 2.1 time: 0.167434 Aug 31 07:09:18.432033 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 465/963] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:18 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1653 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:18.451887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a2cc7629-5b35-4ddc-baa2-d065979e652f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:09:18.458634 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2cc7629-5b35-4ddc-baa2-d065979e652f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:18.459152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2cc7629-5b35-4ddc-baa2-d065979e652f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:18.459558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a2cc7629-5b35-4ddc-baa2-d065979e652f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:18.481853 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a2cc7629-5b35-4ddc-baa2-d065979e652f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Going to try to start instance {{(pid=120770) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 07:09:18.529323 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a2cc7629-5b35-4ddc-baa2-d065979e652f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action" status: 202 len: 0 microversion: 2.1 time: 0.080986 Aug 31 07:09:18.530157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 499/964] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:09:18 2022] POST /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:09:18.539017 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:18.539627 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:18.546201 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:18.546790 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:18.547337 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:18.548015 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:18.548672 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:18.549117 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:18.732668 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:18.741395 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-c5d81c07-4c6f-4768-bd94-b66302bb51c2 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1662 microversion: 2.1 time: 0.206754 Aug 31 07:09:18.741972 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 466/965] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:18 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1662 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:09:19.765182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:19.765881 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:19.776546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:19.776888 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:19.777323 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:19.778218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:19.778681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:19.779123 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:19.926739 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:19.934959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-176e6e06-c779-492e-a3e2-d9573bf0e210 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1666 microversion: 2.1 time: 0.174767 Aug 31 07:09:19.935683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 500/966] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:19 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1666 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:52.882832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1466768234", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-370224798", "security_groups": [{"name": "tempest-secgroup-smoke-1092924035"}], "block_device_mapping_v2": [{"uuid": "ab5cb552-564c-44d7-9482-5ceae26c21cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66ebf559-4ea4-4b90-866a-bf1d2835263f"}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:09:52.893701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=9 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:09:52.894728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=55 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:09:53.013513 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] validate_networks() for [('66ebf559-4ea4-4b90-866a-bf1d2835263f', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:09:53.437424 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:09:53.437687 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:09:53.438251 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:09:53.438711 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:09:53.439669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:09:53.451674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:53.452227 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:53.452650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:53.453535 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:53.453980 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:53.454396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:53.472442 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:09:53.476385 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Getting quotas for user dcce3144380d4577b91f3e83304f94dd and project ea4b3039f2144c18b9d78267241b1a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:09:53.539376 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:09:53.541500 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab5cb552-564c-44d7-9482-5ceae26c21cc',volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:09:53.686414 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-82c6ce5e-6f8d-46b1-81fa-81b9af68b042 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.807894 Aug 31 07:09:53.687097 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 467/967] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:09:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:09:53.700548 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-15d365da-6dca-4d8e-b547-8058117727f9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:53.701816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-15d365da-6dca-4d8e-b547-8058117727f9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:53.710122 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=24 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:09:53.711548 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:09:53.804036 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-15d365da-6dca-4d8e-b547-8058117727f9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:53.813984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-15d365da-6dca-4d8e-b547-8058117727f9 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1094 microversion: 2.1 time: 0.119384 Aug 31 07:09:53.815226 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 501/968] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:53 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:09:54.837861 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:54.838674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:54.844910 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:54.845531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:54.846142 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:54.847562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:54.848140 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:54.848667 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:54.920370 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:54.928822 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bdcdbfb8-d568-4cb8-ac84-f8bc54f04c2f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1192 microversion: 2.1 time: 0.095771 Aug 31 07:09:54.934977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 468/969] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:54 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:55.950489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:55.951672 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:55.959237 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:55.960022 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:55.960603 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:55.961310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:55.961756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:55.962174 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:56.027461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:56.038041 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-11d84265-ec56-4298-9e7c-c30eda06f441 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1210 microversion: 2.1 time: 0.091980 Aug 31 07:09:56.039917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 502/970] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:55 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:57.061680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:57.062309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:57.070051 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:57.070548 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:57.071176 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:57.072087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:57.072545 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:57.072974 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:57.197623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-3a748d81-e370-4839-ad2b-ffac8a733958 req-e042c56c-7352-4f40-aeba-7785b47a514b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fbddfc-3a86-468f-bad3-d2c915367e05", "tag": "485b67c4-c977-4f03-9043-b0e5a030ce01"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:09:57.216496 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a748d81-e370-4839-ad2b-ffac8a733958 req-e042c56c-7352-4f40-aeba-7785b47a514b service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:57.217700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a748d81-e370-4839-ad2b-ffac8a733958 req-e042c56c-7352-4f40-aeba-7785b47a514b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:57.217700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-3a748d81-e370-4839-ad2b-ffac8a733958 req-e042c56c-7352-4f40-aeba-7785b47a514b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:57.245488 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-3a748d81-e370-4839-ad2b-ffac8a733958 req-e042c56c-7352-4f40-aeba-7785b47a514b service nova] Creating event network-changed:485b67c4-c977-4f03-9043-b0e5a030ce01 for instance d0fbddfc-3a86-468f-bad3-d2c915367e05 on hv-cinder-85528 Aug 31 07:09:57.251989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-3a748d81-e370-4839-ad2b-ffac8a733958 req-e042c56c-7352-4f40-aeba-7785b47a514b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058083 Aug 31 07:09:57.252772 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 503/971] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:09:57.355178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:57.363787 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4e3d163e-0442-4422-a0ae-4f6636522a9a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.306347 Aug 31 07:09:57.364386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 469/972] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:57 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:09:58.389058 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:58.390391 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:58.400269 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:58.400963 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:58.401567 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:58.402495 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:58.403202 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:58.404155 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:58.583437 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:58.592774 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2d49cc1a-6406-4c62-acd0-7de1361b2b0f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.211380 Aug 31 07:09:58.594255 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 504/973] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:58 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:09:59.616550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:09:59.617324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:09:59.623999 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:59.624488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:59.624982 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:59.625686 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:09:59.626132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:09:59.626890 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:09:59.799898 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:09:59.815307 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-48d8301c-d655-41e3-ba04-2faf4badebae tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.200876 Aug 31 07:09:59.828733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 470/974] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:09:59 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:00.836187 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:00.836784 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:00.843796 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:00.844284 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:00.844717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:00.845408 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:00.846096 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:00.846543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:00.985985 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:00.994887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-56a88a7b-a1f5-477c-a184-3d77ba7290b7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.162739 Aug 31 07:10:00.995472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 505/975] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:00 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:01.499151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:01.501381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:01.511429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:01.511918 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:01.512357 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:01.513066 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:01.513625 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:01.514034 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:01.546340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-593df822-9bbc-45e7-863b-045df6b8f83c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051244 Aug 31 07:10:01.546921 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 471/976] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:10:01 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:10:01.610945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:01.611465 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:01.617890 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:01.618382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:01.618805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:01.619609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:01.620140 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:01.620558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:01.651706 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:10:01.738401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-22c90a21-05d6-49e3-8765-23b0a51735a5 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 204 len: 0 microversion: 2.1 time: 0.130944 Aug 31 07:10:01.739445 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 506/977] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:10:01 2022] DELETE /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:10:01.747852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:01.748645 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:01.749429 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-519699237", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "networks": [{"uuid": "473a7f71-96d9-46f0-8d93-905362b3cc16"}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:01.754805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:01.755325 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:01.755759 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:01.756484 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:01.757008 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:01.757358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:01.810061 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] validate_networks() for [('473a7f71-96d9-46f0-8d93-905362b3cc16', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:10:01.890080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:01.898219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4c698551-17d7-4493-bb76-3d1d2351b30f tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1672 microversion: 2.1 time: 0.154505 Aug 31 07:10:01.898795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 507/978] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:01 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:10:02.021920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:02.022548 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:02.028868 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:02.029348 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:02.029777 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:02.030470 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:02.030938 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:02.031359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:02.157682 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:10:02.158093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:10:02.158547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:10:02.158985 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:10:02.159390 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:10:02.166240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:02.168796 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:02.169272 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:02.169700 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:02.170416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:02.170877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:02.171296 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:02.174433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-498e4191-a104-4c10-acfa-cbf25c34511b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.156879 Aug 31 07:10:02.175033 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 508/979] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:02 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:02.188801 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Getting quotas for project 249003536fe0438caa923a51cb778d62. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:10:02.193024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Getting quotas for user ac5dbf7fc1bd477196a0738b494beb6a and project 249003536fe0438caa923a51cb778d62. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:10:02.203789 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:10:02.205953 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:10:02.253162 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6fc42731-7ef8-4c0a-9586-b1613d8ef6f3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509081 Aug 31 07:10:02.254288 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 472/980] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:10:02.265639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2ef0a458-6890-45cf-a1af-8e5822b7f13a tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:02.266211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2ef0a458-6890-45cf-a1af-8e5822b7f13a tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:02.322106 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2ef0a458-6890-45cf-a1af-8e5822b7f13a tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:02.328940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2ef0a458-6890-45cf-a1af-8e5822b7f13a tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1213 microversion: 2.1 time: 0.067299 Aug 31 07:10:02.329524 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 509/981] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:02 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:02.919893 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:02.920501 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:02.927038 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:02.927531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:02.927967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:02.928664 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:02.929102 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:02.929527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:03.065010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:03.072975 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a1fd0915-a683-4481-acce-9ea067a74343 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1672 microversion: 2.1 time: 0.157992 Aug 31 07:10:03.073630 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 473/982] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:02 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:03.194909 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:03.195551 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:03.202496 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:03.203099 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:03.203534 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:03.204229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:03.204687 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:03.205100 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:03.349264 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:03.351185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:03.351879 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:03.358250 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-987e232c-a5ca-4e0e-866d-90ab038a011f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.167163 Aug 31 07:10:03.358403 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:03.358823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 510/983] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:03 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:03.366326 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:03.367001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:03.367801 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:03.368334 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:03.368822 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:03.436717 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:03.444618 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e1b74f9b-fea0-4d45-8223-1ded22b714cb tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1217 microversion: 2.1 time: 0.098329 Aug 31 07:10:03.445192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 474/984] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:03 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:04.101088 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:04.103432 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:04.120615 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:04.121218 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:04.121626 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:04.122380 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:04.122823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:04.123398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:04.278318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:04.289265 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b5636dd4-3a5b-4452-8aed-3e5b68a43907 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1672 microversion: 2.1 time: 0.196398 Aug 31 07:10:04.289861 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 511/985] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:04 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:04.381699 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:04.382311 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:04.389224 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:04.389916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:04.390374 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:04.391093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:04.391543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:04.391960 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:04.472427 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:04.477303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:04.483783 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:04.484267 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:04.484699 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:04.485399 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:04.485850 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:04.486258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:04.550087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:04.559211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3a9d1951-177b-45a7-a1db-3edb1307e013 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1209 microversion: 2.1 time: 0.090496 Aug 31 07:10:04.559795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 512/986] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:04 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:04.618514 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:04.627185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-60c37272-cdfe-4405-8e47-12266107d5dc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.250785 Aug 31 07:10:04.628056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 475/987] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:04 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:05.315350 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:05.316666 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:05.328658 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:05.329389 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:05.330080 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:05.331610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:05.332202 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:05.332631 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:05.416901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:05.433755 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c4a1553f-b81e-4a1f-901f-c8089e72ca00 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 200 len: 1605 microversion: 2.1 time: 0.123341 Aug 31 07:10:05.434447 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 513/988] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:05 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 1605 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:05.585923 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:05.592528 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:05.605774 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:05.606125 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-75d4abc3-a0dd-46b4-87db-b5b85e0bb5eb req-2003f650-5a98-4af7-a775-21bf87f26c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7580179a-eac1-45f0-ab8f-0bb0572699af", "name": "network-vif-deleted", "tag": "0afb8a58-774f-421f-a423-54b2b634db6d"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:05.609257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:05.610303 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:05.612881 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:05.614319 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:05.615134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:05.631551 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-75d4abc3-a0dd-46b4-87db-b5b85e0bb5eb req-2003f650-5a98-4af7-a775-21bf87f26c09 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:05.632355 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-75d4abc3-a0dd-46b4-87db-b5b85e0bb5eb req-2003f650-5a98-4af7-a775-21bf87f26c09 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:05.633100 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-75d4abc3-a0dd-46b4-87db-b5b85e0bb5eb req-2003f650-5a98-4af7-a775-21bf87f26c09 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:05.649703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-75d4abc3-a0dd-46b4-87db-b5b85e0bb5eb req-2003f650-5a98-4af7-a775-21bf87f26c09 service nova] Creating event network-vif-deleted:0afb8a58-774f-421f-a423-54b2b634db6d for instance 7580179a-eac1-45f0-ab8f-0bb0572699af on hv-cinder-85528 Aug 31 07:10:05.655377 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-75d4abc3-a0dd-46b4-87db-b5b85e0bb5eb req-2003f650-5a98-4af7-a775-21bf87f26c09 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067775 Aug 31 07:10:05.656596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 514/989] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:05.662836 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:05.663778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:05.680020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:05.681917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:05.682623 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:05.698745 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:05.699580 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:05.701041 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:05.775924 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:05.785603 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-adebdec6-b4f5-49cf-9a4c-5d7d36f568e3 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1271 microversion: 2.1 time: 0.208606 Aug 31 07:10:05.789938 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 476/990] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:05 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:05.943387 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:05.964622 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8a796d18-224c-4e0c-86d0-61a1601681e1 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.304754 Aug 31 07:10:05.967749 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 515/991] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:05 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:06.459113 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:06.460075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:06.466782 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:06.467620 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:06.468260 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:06.469192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:06.470109 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:06.470740 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:06.490165 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] HTTP exception thrown: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Request method failure captured: Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af HTTP/1.1 Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwiQfmiwtD9L2WafMT0WGz3D82OdpwL27kMJ_luEobLn4ijfUEz0VBrrZ2SeqhSW0t5yKPoCzO8wBhuaXCm5o8DFy_f3RG4pH5JnikwZjOIOCQa9KaH9avMUtwM8wMEeRJKruSqrLk5mBBBCQ0_VkSE_HxbntNlQLNsAim_fWSoAjaw Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:10:06.494519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2fef3f2705c4f77af57dabe57e8f523", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: ce4e97b4b681489e8c427ea3846b62c6 Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:10:06.496006 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '7580179a-eac1-45f0-ab8f-0bb0572699af'} Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:10:06.496802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:10:06.498100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:06.499280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Returning 404 to user: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:10:06.499359 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-eabd6a32-bda6-4d3d-9091-d65852e132fd tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 404 len: 111 microversion: 2.1 time: 0.044247 Aug 31 07:10:06.503255 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 477/992] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:06 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:10:06.510215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2632a4cd-d968-4128-b06b-592e286b6dda tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '.version_select at 0x7ff9c06865e0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:06.542239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2632a4cd-d968-4128-b06b-592e286b6dda tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885064642" status: 202 len: 0 microversion: 2.1 time: 0.035813 Aug 31 07:10:06.545833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 516/993] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 31 07:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885064642 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 07:10:06.810649 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:06.811370 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:06.830578 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:06.831505 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:06.832215 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:06.833276 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:06.834210 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:06.834869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:06.991995 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:06.992883 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:07.008420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:07.009610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:07.010598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:07.015752 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:07.020618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:07.030339 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:07.321302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:07.332670 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-18641b6a-08ae-424e-bd8c-a86cd8fe4f2e tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1313 microversion: 2.1 time: 0.525665 Aug 31 07:10:07.333573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 478/994] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:06 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:07.363561 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:07.375896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ee87ba68-4cb4-4b0c-b0c6-a1624456e5fe tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.388438 Aug 31 07:10:07.391245 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 517/995] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:06 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:07.591274 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8d95db46-5074-477d-9159-9bce25ed0e7a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'create', calling method: .version_select at 0x7ff9c1f21dc0>, body: {"keypair": {"name": "tempest-keypair-1790781645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOhFnaGNhWyowyOWXoULAZpBRMZBAlpw3dW1M+dQeL4u/u8wkvago50J2Cwc+EZWDunk8ZqWWC74INTbpiuLInrp1734+HRfqblgFiD3+uj+cLIv0MxIZXN5kE7jp1Emw=="}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:07.609007 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-8d95db46-5074-477d-9159-9bce25ed0e7a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:10:07.613515 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-8d95db46-5074-477d-9159-9bce25ed0e7a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for user ce4e97b4b681489e8c427ea3846b62c6 and project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:10:07.643786 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8d95db46-5074-477d-9159-9bce25ed0e7a tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056607 Aug 31 07:10:07.644404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 479/996] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:10:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:07.696722 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-d991d8b3-4a9f-436f-8203-320add378172 req-9851fefd-7ce8-40f8-b514-9e385725de74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5beaac-8170-4169-84b0-093712bfa5f0", "tag": "b7adbcd8-a103-4776-9921-78981f011352"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:07.711251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d991d8b3-4a9f-436f-8203-320add378172 req-9851fefd-7ce8-40f8-b514-9e385725de74 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:07.711736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d991d8b3-4a9f-436f-8203-320add378172 req-9851fefd-7ce8-40f8-b514-9e385725de74 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:07.713879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d991d8b3-4a9f-436f-8203-320add378172 req-9851fefd-7ce8-40f8-b514-9e385725de74 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:07.732581 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-d991d8b3-4a9f-436f-8203-320add378172 req-9851fefd-7ce8-40f8-b514-9e385725de74 service nova] Creating event network-changed:b7adbcd8-a103-4776-9921-78981f011352 for instance 8a5beaac-8170-4169-84b0-093712bfa5f0 on hv-cinder-85528 Aug 31 07:10:07.737909 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-d991d8b3-4a9f-436f-8203-320add378172 req-9851fefd-7ce8-40f8-b514-9e385725de74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045070 Aug 31 07:10:07.739578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 518/997] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:07.851241 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-3915fdee-ec71-4b06-8483-f9509dc740b9 req-b654f823-f90b-4d3e-82fa-549a68634776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fbddfc-3a86-468f-bad3-d2c915367e05", "name": "network-vif-plugged", "status": "completed", "tag": "485b67c4-c977-4f03-9043-b0e5a030ce01"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:07.869843 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-3915fdee-ec71-4b06-8483-f9509dc740b9 req-b654f823-f90b-4d3e-82fa-549a68634776 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:07.870692 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-3915fdee-ec71-4b06-8483-f9509dc740b9 req-b654f823-f90b-4d3e-82fa-549a68634776 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:07.871364 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-3915fdee-ec71-4b06-8483-f9509dc740b9 req-b654f823-f90b-4d3e-82fa-549a68634776 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:07.885566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-3915fdee-ec71-4b06-8483-f9509dc740b9 req-b654f823-f90b-4d3e-82fa-549a68634776 service nova] Creating event network-vif-plugged:485b67c4-c977-4f03-9043-b0e5a030ce01 for instance d0fbddfc-3a86-468f-bad3-d2c915367e05 on hv-cinder-85528 Aug 31 07:10:07.891492 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-3915fdee-ec71-4b06-8483-f9509dc740b9 req-b654f823-f90b-4d3e-82fa-549a68634776 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045455 Aug 31 07:10:07.892602 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 480/998] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:08.354681 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:08.355562 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:08.362431 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:08.363167 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:08.364238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:08.365198 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:08.365651 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:08.366090 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:08.398658 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:08.399377 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:08.405977 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:08.406521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:08.406989 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:08.407686 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:08.408433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:08.408859 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:08.559978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:08.571425 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dea33427-0e85-468b-a6f5-cae495bc8a3b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.177155 Aug 31 07:10:08.577461 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:08.584100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 481/999] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:08 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:10:08.588655 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ef1c0475-57d7-4a84-83c1-995fa6fc5b78 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1313 microversion: 2.1 time: 0.238389 Aug 31 07:10:08.589229 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 519/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:08 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:09.497815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-689995995", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a96f0399-d3ea-4de7-a42f-ba811bd374c8"}], "security_groups": [{"name": "tempest-securitygroup--909985855"}], "key_name": "tempest-keypair-1790781645", "user_data": "}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:09.594121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:09.594693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:09.602100 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:09.602641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] validate_networks() for [('a96f0399-d3ea-4de7-a42f-ba811bd374c8', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:10:09.602788 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:09.603266 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:09.604036 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:09.604557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:09.605076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:09.763405 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:09.767947 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:09.775940 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b7eb1a44-b6a0-4abc-8f41-03653472db13 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1266 microversion: 2.1 time: 0.185633 Aug 31 07:10:09.777100 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 520/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:09 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:09.784584 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:09.785252 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:09.791742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:09.792476 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:09.793217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:09.793914 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:09.794354 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:09.794766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:09.940932 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:09.948704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ea331a09-b0b1-4f68-ba83-33b584d54ece tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1313 microversion: 2.1 time: 0.170226 Aug 31 07:10:09.949276 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 521/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:09 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:10.142674 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:10:10.143324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:10:10.144079 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:10:10.144835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:10:10.145468 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:10:10.155278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.155791 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:10.156221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:10.156949 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.157397 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:10.157817 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:10.175410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:10:10.180710 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Getting quotas for user ce4e97b4b681489e8c427ea3846b62c6 and project a2fef3f2705c4f77af57dabe57e8f523. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:10:10.195969 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:10:10.198597 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:10:10.251831 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4544d2d3-80ff-4b0a-93ac-1afc4de6388c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.758300 Aug 31 07:10:10.252864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 482/1003] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:10:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:10:10.263434 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8c096683-5a71-49bd-bca5-c632d6c1a27b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:10.264322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8c096683-5a71-49bd-bca5-c632d6c1a27b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:10.321321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8c096683-5a71-49bd-bca5-c632d6c1a27b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:10.328993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8c096683-5a71-49bd-bca5-c632d6c1a27b tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1237 microversion: 2.1 time: 0.069568 Aug 31 07:10:10.329556 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 522/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:10 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:10:10.798451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:10.799089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:10.805776 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.806265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:10.806700 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:10.807467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.807916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:10.808486 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:10.957381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:10.966096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-fd63344b-e903-4943-b96b-e8d429498437 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1453 microversion: 2.1 time: 0.172132 Aug 31 07:10:10.966677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 483/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:10 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:10.975489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:10.976095 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:10.984628 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.985468 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:10.986098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:10.987388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.988151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:10.988792 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:10.988916 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:10.989487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:10.996467 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.997310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:10.997926 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:10.998818 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:10.999526 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:11.000105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:11.145917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:11.156730 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-078c8723-7c23-4256-bc74-ce6dbeddf09b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1313 microversion: 2.1 time: 0.185128 Aug 31 07:10:11.157906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 523/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:10 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:11.182025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:11.193713 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-219ff108-5bad-47fa-b3ce-39a4e3f8e1f8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1453 microversion: 2.1 time: 0.208710 Aug 31 07:10:11.194323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 484/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:10 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:11.354711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:11.354711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:11.366390 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:11.366993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:11.367538 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:11.370820 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:11.371417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:11.372046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:11.464520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:11.473417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-561fdf66-9b8e-4386-a508-2ea2845c8717 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1289 microversion: 2.1 time: 0.123285 Aug 31 07:10:11.474005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 524/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:11 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:11.808487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-0ce2c485-ea31-49e2-b862-40d4efa3ff04 req-0f319638-b651-48d9-a0ed-7498884b0d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5beaac-8170-4169-84b0-093712bfa5f0", "name": "network-vif-plugged", "status": "completed", "tag": "b7adbcd8-a103-4776-9921-78981f011352"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:11.819101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-0ce2c485-ea31-49e2-b862-40d4efa3ff04 req-0f319638-b651-48d9-a0ed-7498884b0d6e service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:11.819714 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-0ce2c485-ea31-49e2-b862-40d4efa3ff04 req-0f319638-b651-48d9-a0ed-7498884b0d6e service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:11.820132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-0ce2c485-ea31-49e2-b862-40d4efa3ff04 req-0f319638-b651-48d9-a0ed-7498884b0d6e service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:11.834659 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-0ce2c485-ea31-49e2-b862-40d4efa3ff04 req-0f319638-b651-48d9-a0ed-7498884b0d6e service nova] Creating event network-vif-plugged:b7adbcd8-a103-4776-9921-78981f011352 for instance 8a5beaac-8170-4169-84b0-093712bfa5f0 on hv-cinder-85528 Aug 31 07:10:11.840558 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-0ce2c485-ea31-49e2-b862-40d4efa3ff04 req-0f319638-b651-48d9-a0ed-7498884b0d6e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Aug 31 07:10:11.841166 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 485/1009] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:12.180270 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:12.180882 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:12.187874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:12.188392 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:12.188826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:12.189520 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:12.190170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:12.190592 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:12.329756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:12.337792 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-169189b1-f8bd-41a7-bd7f-b41fd9b3c9fd tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1313 microversion: 2.1 time: 0.161757 Aug 31 07:10:12.338450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 525/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:12 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:12.494555 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:12.495396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:12.501832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:12.502419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:12.502876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:12.503651 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:12.504173 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:12.504657 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:12.613404 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:12.621539 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6439173f-63b9-403e-938a-3c2bcfcc44d4 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1295 microversion: 2.1 time: 0.131386 Aug 31 07:10:12.622677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 486/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:12 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:13.359291 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:13.359925 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:13.367353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:13.367816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:13.368254 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:13.368943 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:13.369382 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:13.369766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:13.503067 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:13.511081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-51ff6459-d183-4bf3-9490-4cb84e8c11e6 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1313 microversion: 2.1 time: 0.155853 Aug 31 07:10:13.511659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 526/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:13 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:13.644141 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:13.644849 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:13.651611 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:13.652863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:13.653161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:13.654129 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:13.654774 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:13.655322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:13.986438 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:13.997971 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e47b7ece-5556-4981-8b94-312deb4696f3 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1362 microversion: 2.1 time: 0.357864 Aug 31 07:10:14.007506 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 487/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:13 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:14.519121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-6b67868a-56f3-4620-b43d-14926f4891f7 req-98c90047-0cc9-4b25-aaad-efd1856734cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54242f6a-ba12-43cf-b07b-94ac7e239a20", "tag": "7e958dd2-fe48-44ac-aa72-a77a5ce85300"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:14.531433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-6b67868a-56f3-4620-b43d-14926f4891f7 req-98c90047-0cc9-4b25-aaad-efd1856734cb service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:14.532186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-6b67868a-56f3-4620-b43d-14926f4891f7 req-98c90047-0cc9-4b25-aaad-efd1856734cb service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:14.532624 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-6b67868a-56f3-4620-b43d-14926f4891f7 req-98c90047-0cc9-4b25-aaad-efd1856734cb service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:14.532737 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:14.533338 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:14.542278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:14.545611 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-6b67868a-56f3-4620-b43d-14926f4891f7 req-98c90047-0cc9-4b25-aaad-efd1856734cb service nova] Creating event network-changed:7e958dd2-fe48-44ac-aa72-a77a5ce85300 for instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 on hv-cinder-85528 Aug 31 07:10:14.545864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:14.546336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:14.549060 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:14.549874 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:14.550347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:14.550804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:14.553892 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-6b67868a-56f3-4620-b43d-14926f4891f7 req-98c90047-0cc9-4b25-aaad-efd1856734cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038284 Aug 31 07:10:14.554756 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 527/1014] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:14.583642 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=100 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:14.804421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:14.813213 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-65e28a21-282d-45b0-b708-5ee68af21c87 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1496 microversion: 2.1 time: 0.284705 Aug 31 07:10:14.818869 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 488/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:14 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1496 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:10:15.024064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:15.026235 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:15.036544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:15.037901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:15.038490 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:15.039860 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:15.040479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:15.041564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:15.196901 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:15.204735 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7813bc91-1e49-4002-a303-18c8a2ab0daa tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1362 microversion: 2.1 time: 0.189710 Aug 31 07:10:15.205302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 528/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:15 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:15.346826 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:15.347547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:15.354302 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:15.354870 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:15.355335 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:15.356035 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:15.356495 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:15.356915 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:15.387871 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:10:15.468431 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-3c910bd0-bb19-44f2-8f31-9c50b75918d7 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 204 len: 0 microversion: 2.1 time: 0.125678 Aug 31 07:10:15.469028 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 489/1017] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:10:15 2022] DELETE /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:10:15.481519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:15.482117 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:15.489976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:15.490659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:15.491113 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:15.491807 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:15.492251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:15.492833 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:15.637711 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:15.646426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f4637566-71c5-46f8-aa5e-2c23849594c4 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1502 microversion: 2.1 time: 0.169110 Aug 31 07:10:15.647384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 529/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:15 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:16.224839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:16.225532 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:16.232161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:16.232648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:16.233087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:16.234270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:16.234270 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:16.234788 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:16.369322 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:16.377333 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a53157f4-029b-41f6-9351-e96bc203a5bc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1362 microversion: 2.1 time: 0.156779 Aug 31 07:10:16.377909 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 490/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:16 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:16.570450 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-1c53eff1-0d0b-4745-8c59-447c042a4e16 req-e161608c-64ce-4ca1-a5ef-d8fd9ee510f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fbddfc-3a86-468f-bad3-d2c915367e05", "tag": "485b67c4-c977-4f03-9043-b0e5a030ce01"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:16.580684 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-1c53eff1-0d0b-4745-8c59-447c042a4e16 req-e161608c-64ce-4ca1-a5ef-d8fd9ee510f8 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:16.581249 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-1c53eff1-0d0b-4745-8c59-447c042a4e16 req-e161608c-64ce-4ca1-a5ef-d8fd9ee510f8 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:16.581741 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-1c53eff1-0d0b-4745-8c59-447c042a4e16 req-e161608c-64ce-4ca1-a5ef-d8fd9ee510f8 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:16.593486 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-1c53eff1-0d0b-4745-8c59-447c042a4e16 req-e161608c-64ce-4ca1-a5ef-d8fd9ee510f8 service nova] Creating event network-changed:485b67c4-c977-4f03-9043-b0e5a030ce01 for instance d0fbddfc-3a86-468f-bad3-d2c915367e05 on hv-cinder-85528 Aug 31 07:10:16.598560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-1c53eff1-0d0b-4745-8c59-447c042a4e16 req-e161608c-64ce-4ca1-a5ef-d8fd9ee510f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Aug 31 07:10:16.599104 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 530/1020] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:16.668675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:16.669284 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:16.675309 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:16.675808 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:16.676498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:16.677201 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:16.677650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:16.678075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:16.813608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:16.821452 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-48c4a65c-3d6d-41ed-b8fd-a878ff921d09 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1502 microversion: 2.1 time: 0.157054 Aug 31 07:10:16.822018 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 491/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:16 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:17.398300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:17.399027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:17.405737 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:17.406174 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:17.406599 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:17.407409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:17.407856 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:17.408300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:17.549742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:17.560366 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-73af4a34-2d57-47b8-8536-8eedf667f88e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1362 microversion: 2.1 time: 0.166454 Aug 31 07:10:17.561482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 531/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:17 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:17.847707 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:17.850412 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:17.860986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:17.861841 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:17.862503 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:17.864239 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:17.870498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:17.871629 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:18.266278 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:18.277262 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-922a0474-e9fd-4317-be32-0a5e8b71ec01 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 200 len: 1502 microversion: 2.1 time: 0.436672 Aug 31 07:10:18.278114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 492/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:17 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 1502 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:18.309305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-ff4b9d6d-9aed-44bf-87d3-ed1e67da2cdb req-ddbbda9e-cf51-4c7c-9650-9065d61f6c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5beaac-8170-4169-84b0-093712bfa5f0", "name": "network-vif-deleted", "tag": "b7adbcd8-a103-4776-9921-78981f011352"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:18.319047 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-ff4b9d6d-9aed-44bf-87d3-ed1e67da2cdb req-ddbbda9e-cf51-4c7c-9650-9065d61f6c89 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:18.319610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-ff4b9d6d-9aed-44bf-87d3-ed1e67da2cdb req-ddbbda9e-cf51-4c7c-9650-9065d61f6c89 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:18.320126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-ff4b9d6d-9aed-44bf-87d3-ed1e67da2cdb req-ddbbda9e-cf51-4c7c-9650-9065d61f6c89 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:18.332065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-ff4b9d6d-9aed-44bf-87d3-ed1e67da2cdb req-ddbbda9e-cf51-4c7c-9650-9065d61f6c89 service nova] Creating event network-vif-deleted:b7adbcd8-a103-4776-9921-78981f011352 for instance 8a5beaac-8170-4169-84b0-093712bfa5f0 on hv-cinder-85528 Aug 31 07:10:18.347822 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-ff4b9d6d-9aed-44bf-87d3-ed1e67da2cdb req-ddbbda9e-cf51-4c7c-9650-9065d61f6c89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042471 Aug 31 07:10:18.351299 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 532/1024] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:18.581166 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:18.582014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:18.588089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:18.588553 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:18.588978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:18.589833 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:18.590433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:18.591151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:18.744247 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:18.752252 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-dd1accb8-cf01-4423-ae1b-24470b780b2c tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1362 microversion: 2.1 time: 0.174872 Aug 31 07:10:18.752810 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 493/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:18 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:19.307266 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:19.308359 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: 8a5beaac-8170-4169-84b0-093712bfa5f0] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:19.318291 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:19.318831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:19.319224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:19.319952 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:19.320423 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:19.320829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:19.335244 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] HTTP exception thrown: Instance 8a5beaac-8170-4169-84b0-093712bfa5f0 could not be found. Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Request method failure captured: Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 HTTP/1.1 Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwlIOifb_6n8s6r5DA1vmOj2StaX4DHz2KRWzKqaNZmPshWMQAQu4sgOWUUgwBwQyDrcTv-hPVjvvGO2WzM90KbdtxsJ3A8k_QNdW8ZzU7VO73zf9Gy-9cEz6X2XFbVGo4JsdWlUyuCuWphTYQld4pb9KY1C5h-8W0AUlaiUHlNq9tY Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: 249003536fe0438caa923a51cb778d62 Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-VolumesActionsTest-143626233 Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:10:19.336905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/249003536fe0438caa923a51cb778d62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/249003536fe0438caa923a51cb778d62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_249003536fe0438caa923a51cb778d62", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/249003536fe0438caa923a51cb778d62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-VolumesActionsTest-143626233 Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: 249003536fe0438caa923a51cb778d62 Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-VolumesActionsTest-143626233 Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-VolumesActionsTest-143626233-project Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: ac5dbf7fc1bd477196a0738b494beb6a Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-VolumesActionsTest-143626233-project Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 8a5beaac-8170-4169-84b0-093712bfa5f0 could not be found. Aug 31 07:10:19.338640 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '8a5beaac-8170-4169-84b0-093712bfa5f0'} Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a5beaac-8170-4169-84b0-093712bfa5f0 could not be found. Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:10:19.339835 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a5beaac-8170-4169-84b0-093712bfa5f0 could not be found. Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a5beaac-8170-4169-84b0-093712bfa5f0 could not be found. Aug 31 07:10:19.342675 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:10:19.344438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Returning 404 to user: Instance 8a5beaac-8170-4169-84b0-093712bfa5f0 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:10:19.344438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bc16c766-0f59-46bb-ba33-2cd7686baf67 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0" status: 404 len: 111 microversion: 2.1 time: 0.037643 Aug 31 07:10:19.344438 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 533/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:19 2022] GET /compute/v2.1/servers/8a5beaac-8170-4169-84b0-093712bfa5f0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:10:19.443640 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1151104109", "imageRef": "dba9ce70-9d86-4b10-8835-8b3dfad8bf44", "flavorRef": "452", "networks": [{"uuid": "473a7f71-96d9-46f0-8d93-905362b3cc16"}]}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:19.501669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.network.neutron [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] validate_networks() for [('473a7f71-96d9-46f0-8d93-905362b3cc16', None, None, None, None, None)] {{(pid=120771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:10:19.775452 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:19.776489 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:19.784927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:19.785951 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:19.786397 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:19.787157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:19.787606 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:19.788549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:19.999909 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:20.010076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5e938184-5aa7-441b-a90c-2ff6acaff1d0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1362 microversion: 2.1 time: 0.240398 Aug 31 07:10:20.010658 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 534/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:19 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:20.023717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-0abdae4d-932d-4ab9-bf2a-cd1b5197249f req-0cceaa39-4692-4449-ae33-a754bfe37593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54242f6a-ba12-43cf-b07b-94ac7e239a20", "name": "network-vif-plugged", "status": "completed", "tag": "7e958dd2-fe48-44ac-aa72-a77a5ce85300"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:20.028758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0abdae4d-932d-4ab9-bf2a-cd1b5197249f req-0cceaa39-4692-4449-ae33-a754bfe37593 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:20.029321 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0abdae4d-932d-4ab9-bf2a-cd1b5197249f req-0cceaa39-4692-4449-ae33-a754bfe37593 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:20.029823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-0abdae4d-932d-4ab9-bf2a-cd1b5197249f req-0cceaa39-4692-4449-ae33-a754bfe37593 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:20.042620 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-0abdae4d-932d-4ab9-bf2a-cd1b5197249f req-0cceaa39-4692-4449-ae33-a754bfe37593 service nova] Creating event network-vif-plugged:7e958dd2-fe48-44ac-aa72-a77a5ce85300 for instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 on hv-cinder-85528 Aug 31 07:10:20.048083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-0abdae4d-932d-4ab9-bf2a-cd1b5197249f req-0cceaa39-4692-4449-ae33-a754bfe37593 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034184 Aug 31 07:10:20.048795 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 535/1028] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:20.164234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=6 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:20.171010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Flavor limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:10:20.171440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Image limits 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:10:20.172002 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Flavor pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:10:20.172493 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Image pref 0:0:0 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:10:20.172970 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.virt.hardware [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:10:20.182878 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:20.183524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:20.183940 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:20.184672 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:20.185150 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:20.185614 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:20.204421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Getting quotas for project 249003536fe0438caa923a51cb778d62. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:10:20.209610 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Getting quotas for user ac5dbf7fc1bd477196a0738b494beb6a and project 249003536fe0438caa923a51cb778d62. Resources: {'ram', 'cores', 'instances'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:10:20.221321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Going to run 1 instances... {{(pid=120771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:10:20.224024 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dba9ce70-9d86-4b10-8835-8b3dfad8bf44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:10:20.273785 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9295bf83-28c8-4bfd-abf0-a2ec6f332987 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835556 Aug 31 07:10:20.274538 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 494/1029] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:10:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:10:20.286349 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8d75a2ee-ebcc-400e-9cf2-8515761c746d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:20.287295 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8d75a2ee-ebcc-400e-9cf2-8515761c746d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:20.335555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=6 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:20.344482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8d75a2ee-ebcc-400e-9cf2-8515761c746d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:20.351580 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8d75a2ee-ebcc-400e-9cf2-8515761c746d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1214 microversion: 2.1 time: 0.069572 Aug 31 07:10:20.352778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 536/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:20 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:21.031543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:21.032157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:21.039644 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:21.040421 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:21.040848 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:21.041561 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:21.041996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:21.042416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:21.185544 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:21.193829 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-22673ab5-5c03-4239-a6a0-5d59b44882cf tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1362 microversion: 2.1 time: 0.166224 Aug 31 07:10:21.194535 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 495/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:21 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:21.373540 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:21.374232 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:21.381464 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:21.382019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:21.382542 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:21.383317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:21.383827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:21.384328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:21.447872 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:21.455977 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-74d7ae39-63e6-4c2f-9a66-e4a047475714 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1266 microversion: 2.1 time: 0.086296 Aug 31 07:10:21.456558 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 537/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:21 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:22.214087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:22.214839 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:22.221323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:22.221799 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:22.222230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:22.223081 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:22.223423 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:22.223842 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:22.360321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:22.368416 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bc55517e-fe3a-4138-ab21-b1c1c7098fae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1546 microversion: 2.1 time: 0.158214 Aug 31 07:10:22.368989 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 496/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:22 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:10:22.390959 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:22.391589 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:22.399323 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:22.399895 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:22.400539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:22.401867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:22.402718 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:22.403609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:22.479465 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:22.480459 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:22.488748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:22.489472 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:22.490149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:22.490933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:22.491544 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:22.491985 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:22.500618 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d4149bc5-45c7-46d1-ae19-3e3889c273dc tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115246 Aug 31 07:10:22.501544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 538/1034] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 07:10:22 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:22.634810 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:22.643113 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2450c72d-c9c9-4682-ac6b-d0e07fe775f2 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1284 microversion: 2.1 time: 0.169049 Aug 31 07:10:22.643874 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 497/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:22 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:10:23.664384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:23.665087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:23.678668 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:23.679472 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:23.680165 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:23.681121 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:23.686507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:23.687425 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:23.936505 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:23.946087 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-bde2a172-261a-4589-aec5-8caa1bd3c430 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1314 microversion: 2.1 time: 0.286025 Aug 31 07:10:23.949127 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 539/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:23 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:24.095140 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-107317d2-1c82-431f-8e2d-3184a8452bf3 req-7ff42e46-6c56-4f61-b1bb-82fe34b80178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54242f6a-ba12-43cf-b07b-94ac7e239a20", "tag": "7e958dd2-fe48-44ac-aa72-a77a5ce85300"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:24.118089 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-107317d2-1c82-431f-8e2d-3184a8452bf3 req-7ff42e46-6c56-4f61-b1bb-82fe34b80178 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:24.121114 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-107317d2-1c82-431f-8e2d-3184a8452bf3 req-7ff42e46-6c56-4f61-b1bb-82fe34b80178 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:24.121814 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-107317d2-1c82-431f-8e2d-3184a8452bf3 req-7ff42e46-6c56-4f61-b1bb-82fe34b80178 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:24.169978 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-107317d2-1c82-431f-8e2d-3184a8452bf3 req-7ff42e46-6c56-4f61-b1bb-82fe34b80178 service nova] Creating event network-changed:7e958dd2-fe48-44ac-aa72-a77a5ce85300 for instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 on hv-cinder-85528 Aug 31 07:10:24.186249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-107317d2-1c82-431f-8e2d-3184a8452bf3 req-7ff42e46-6c56-4f61-b1bb-82fe34b80178 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094739 Aug 31 07:10:24.188365 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 498/1037] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:24.972153 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:24.973019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:24.985916 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:24.990297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:24.994697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:24.995395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:24.996163 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:24.998514 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:25.000897 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:25.459170 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:25.474717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-333817d8-0d97-4a17-860c-2445814df09d tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1314 microversion: 2.1 time: 0.508471 Aug 31 07:10:25.475735 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 540/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:24 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:26.218127 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-177c4e8d-c328-40fe-9a19-8314c547ad3c req-91b416a9-e4dc-4ffc-9340-bffc40cd9722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62658b0-a959-43f7-bc9e-ab8593d7951d", "tag": "39070924-83f9-4308-acbc-14ec86833255"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:26.244504 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-177c4e8d-c328-40fe-9a19-8314c547ad3c req-91b416a9-e4dc-4ffc-9340-bffc40cd9722 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:26.247315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-177c4e8d-c328-40fe-9a19-8314c547ad3c req-91b416a9-e4dc-4ffc-9340-bffc40cd9722 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:26.248482 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-177c4e8d-c328-40fe-9a19-8314c547ad3c req-91b416a9-e4dc-4ffc-9340-bffc40cd9722 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:26.276945 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-177c4e8d-c328-40fe-9a19-8314c547ad3c req-91b416a9-e4dc-4ffc-9340-bffc40cd9722 service nova] Creating event network-changed:39070924-83f9-4308-acbc-14ec86833255 for instance c62658b0-a959-43f7-bc9e-ab8593d7951d on hv-cinder-85528 Aug 31 07:10:26.284920 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-177c4e8d-c328-40fe-9a19-8314c547ad3c req-91b416a9-e4dc-4ffc-9340-bffc40cd9722 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071981 Aug 31 07:10:26.291813 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 499/1039] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:26.496659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:26.498524 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:26.507973 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:26.508762 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:26.509196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:26.510338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:26.510800 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:26.511317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:26.724114 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:26.733606 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b2bf59d9-00ee-4677-8c2b-efc4b1246880 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1314 microversion: 2.1 time: 0.241573 Aug 31 07:10:26.734352 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 541/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:26 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:27.756305 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:27.757000 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:27.773574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:27.774445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:27.775144 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:27.775838 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:27.776358 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:27.777050 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:27.955950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:27.965411 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2180d420-0bef-435d-b595-0653a96f8560 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1314 microversion: 2.1 time: 0.213718 Aug 31 07:10:27.966286 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 500/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:27 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:28.987334 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:28.988644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:28.995862 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:28.996566 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:28.997175 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:28.998037 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:28.998654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:28.999393 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:29.169409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:29.182057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0d91e336-fdba-4ac7-ab68-2480fbaf2de0 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1314 microversion: 2.1 time: 0.197972 Aug 31 07:10:29.184753 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 542/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:28 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:30.013770 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-fca7d9d3-3614-4b03-8a57-637bd1a42372 req-909d9281-f577-4824-84c0-c61393049a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62658b0-a959-43f7-bc9e-ab8593d7951d", "name": "network-vif-plugged", "status": "completed", "tag": "39070924-83f9-4308-acbc-14ec86833255"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:30.035566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fca7d9d3-3614-4b03-8a57-637bd1a42372 req-909d9281-f577-4824-84c0-c61393049a40 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:30.036625 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fca7d9d3-3614-4b03-8a57-637bd1a42372 req-909d9281-f577-4824-84c0-c61393049a40 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:30.038466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-fca7d9d3-3614-4b03-8a57-637bd1a42372 req-909d9281-f577-4824-84c0-c61393049a40 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:30.054304 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-fca7d9d3-3614-4b03-8a57-637bd1a42372 req-909d9281-f577-4824-84c0-c61393049a40 service nova] Creating event network-vif-plugged:39070924-83f9-4308-acbc-14ec86833255 for instance c62658b0-a959-43f7-bc9e-ab8593d7951d on hv-cinder-85528 Aug 31 07:10:30.066396 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-fca7d9d3-3614-4b03-8a57-637bd1a42372 req-909d9281-f577-4824-84c0-c61393049a40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056400 Aug 31 07:10:30.068330 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 501/1043] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:30.207865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:30.209766 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:30.218433 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:30.219247 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:30.219920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:30.220842 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:30.221524 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:30.222179 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:30.245856 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=100 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:30.353239 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:30.409722 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:30.420466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-191481df-58f9-448e-b351-09e87387aa44 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1314 microversion: 2.1 time: 0.216930 Aug 31 07:10:30.421585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 543/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:30 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:31.440207 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:31.441336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=28 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:31.447280 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:31.447973 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:31.456046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:31.456824 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:31.457232 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:31.458245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:31.459053 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:31.459794 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:31.615543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:31.631127 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-fc9e165b-e63e-431d-b7d0-7179086a7b41 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1314 microversion: 2.1 time: 0.191749 Aug 31 07:10:31.636345 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 502/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:31 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:32.658005 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:32.658605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:32.666281 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:32.666763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:32.667225 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:32.668272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:32.668717 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:32.669131 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:32.846511 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:32.854439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c0d2b13e-0cff-4fb4-83dc-94c45f3971e8 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1497 microversion: 2.1 time: 0.200323 Aug 31 07:10:32.855573 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 544/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:32 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:32.976588 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7a9edf48-c5dd-4099-8fce-3b4251049d60 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Action: 'create', calling method: .version_select at 0x7ff9c15079d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1860514809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt0IxctuVUneh+KUiRGhqqfr52jlDfNWpkH4lIMM+bGyWq9FwinbWHIj3QHVKxNlnw/gmMDHSNSapZrrNGtk7F+0J5EGyNeGUe24Z2910qhke4iTNw2gcdSiGAQhvgvOw=="}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:32.994957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-7a9edf48-c5dd-4099-8fce-3b4251049d60 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Getting quotas for project ac226422ac824de0810f9033dffe4c98. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:10:32.999277 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.quota [None req-7a9edf48-c5dd-4099-8fce-3b4251049d60 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Getting quotas for user c1230fdc565e4f3bb475eab921b0bc7d and project ac226422ac824de0810f9033dffe4c98. Resources: {'key_pairs'} {{(pid=120771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:10:33.024970 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7a9edf48-c5dd-4099-8fce-3b4251049d60 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.279233 Aug 31 07:10:33.025622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 503/1047] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 07:10:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:10:33.487964 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:33.488578 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:33.497051 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:33.497561 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:33.498003 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:33.498727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:33.499217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:33.499637 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:33.554504 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:10:33.686065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b37fc331-8749-4a7c-aec0-b78eaa5e4874 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 204 len: 0 microversion: 2.1 time: 0.201560 Aug 31 07:10:33.687885 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 545/1048] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:10:33 2022] DELETE /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:10:33.696750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:33.697415 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:33.709417 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:33.710181 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:33.710802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:33.711557 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:33.712003 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:33.712433 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:33.933541 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:33.943410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-1b498a2b-b556-4908-aae3-8a629c86ad50 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1503 microversion: 2.1 time: 0.250824 Aug 31 07:10:33.956896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 504/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:33 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:34.966182 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:34.966879 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:34.975680 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:34.976411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:34.977287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:34.978138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:34.979040 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:34.979605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:35.117515 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:35.127965 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-cd77772d-99db-4062-809f-3af8adb8c145 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1503 microversion: 2.1 time: 0.166059 Aug 31 07:10:35.128574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 546/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:34 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:36.151562 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:36.152213 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:36.159231 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:36.159733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:36.160168 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:36.161067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:36.161519 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:36.161942 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:36.319127 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5dbf7fc1bd477196a0738b494beb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249003536fe0438caa923a51cb778d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:36.319646 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-8ae3343c-00b9-4989-bfe1-4dfeb31f5f10 req-7bf68bc1-0361-4a29-a4a9-179d6b05a72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62658b0-a959-43f7-bc9e-ab8593d7951d", "name": "network-vif-deleted", "tag": "39070924-83f9-4308-acbc-14ec86833255"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:36.328587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-6deef637-4e12-4016-8cf2-91489f7e46d5 tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 200 len: 1461 microversion: 2.1 time: 0.181416 Aug 31 07:10:36.329161 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 505/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:36 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 1461 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:36.333413 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-8ae3343c-00b9-4989-bfe1-4dfeb31f5f10 req-7bf68bc1-0361-4a29-a4a9-179d6b05a72f service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:36.333886 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-8ae3343c-00b9-4989-bfe1-4dfeb31f5f10 req-7bf68bc1-0361-4a29-a4a9-179d6b05a72f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:36.334314 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-8ae3343c-00b9-4989-bfe1-4dfeb31f5f10 req-7bf68bc1-0361-4a29-a4a9-179d6b05a72f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:36.346250 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-8ae3343c-00b9-4989-bfe1-4dfeb31f5f10 req-7bf68bc1-0361-4a29-a4a9-179d6b05a72f service nova] Creating event network-vif-deleted:39070924-83f9-4308-acbc-14ec86833255 for instance c62658b0-a959-43f7-bc9e-ab8593d7951d on hv-cinder-85528 Aug 31 07:10:36.351560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-8ae3343c-00b9-4989-bfe1-4dfeb31f5f10 req-7bf68bc1-0361-4a29-a4a9-179d6b05a72f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036906 Aug 31 07:10:36.352242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 547/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:10:37.350108 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:37.350755 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] [instance: c62658b0-a959-43f7-bc9e-ab8593d7951d] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:37.357593 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:37.358074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:37.358506 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:37.359259 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:37.359678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:37.360100 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:37.377041 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] HTTP exception thrown: Instance c62658b0-a959-43f7-bc9e-ab8593d7951d could not be found. Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Request method failure captured: Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d HTTP/1.1 Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwlIOifb_6n8s6r5DA1vmOj2StaX4DHz2KRWzKqaNZmPshWMQAQu4sgOWUUgwBwQyDrcTv-hPVjvvGO2WzM90KbdtxsJ3A8k_QNdW8ZzU7VO73zf9Gy-9cEz6X2XFbVGo4JsdWlUyuCuWphTYQld4pb9KY1C5h-8W0AUlaiUHlNq9tY Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 249003536fe0438caa923a51cb778d62 Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-VolumesActionsTest-143626233 Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:10:37.378766 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/249003536fe0438caa923a51cb778d62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/249003536fe0438caa923a51cb778d62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_249003536fe0438caa923a51cb778d62", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/249003536fe0438caa923a51cb778d62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-VolumesActionsTest-143626233 Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 249003536fe0438caa923a51cb778d62 Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-VolumesActionsTest-143626233 Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-VolumesActionsTest-143626233-project Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: ac5dbf7fc1bd477196a0738b494beb6a Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-VolumesActionsTest-143626233-project Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance c62658b0-a959-43f7-bc9e-ab8593d7951d could not be found. Aug 31 07:10:37.380366 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'c62658b0-a959-43f7-bc9e-ab8593d7951d'} Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62658b0-a959-43f7-bc9e-ab8593d7951d could not be found. Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:10:37.381461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62658b0-a959-43f7-bc9e-ab8593d7951d could not be found. Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62658b0-a959-43f7-bc9e-ab8593d7951d could not be found. Aug 31 07:10:37.383324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:10:37.386101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] Returning 404 to user: Instance c62658b0-a959-43f7-bc9e-ab8593d7951d could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:10:37.386101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-19cf65a2-d995-4282-badb-d7520af6812b tempest-VolumesActionsTest-143626233 tempest-VolumesActionsTest-143626233-project] 10.222.0.42 "GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d" status: 404 len: 111 microversion: 2.1 time: 0.034280 Aug 31 07:10:37.386101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 506/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:37 2022] GET /compute/v2.1/servers/c62658b0-a959-43f7-bc9e-ab8593d7951d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:10:53.769384 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-906570478", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1860514809", "security_groups": [{"name": "tempest-secgroup-smoke-1988209997"}], "networks": [{"uuid": "b9828d2b-35d5-403d-9d32-96227c33e602"}], "block_device_mapping_v2": [{"uuid": "73523852-4128-4cd3-a5e1-b3650aa1041c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:53.781552 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:53.782728 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:53.908703 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.network.neutron [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] validate_networks() for [('b9828d2b-35d5-403d-9d32-96227c33e602', None, None, None, None, None)] {{(pid=120770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 07:10:54.712715 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Flavor limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 07:10:54.713335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Image limits 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 07:10:54.713821 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Flavor pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 07:10:54.714238 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Image pref 0:0:0 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 07:10:54.714631 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.virt.hardware [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 07:10:54.730977 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:54.731611 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:54.732085 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:54.732933 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:54.733393 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:54.733826 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:54.754664 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Getting quotas for project ac226422ac824de0810f9033dffe4c98. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 07:10:54.759013 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.quota [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Getting quotas for user c1230fdc565e4f3bb475eab921b0bc7d and project ac226422ac824de0810f9033dffe4c98. Resources: {'ram', 'cores', 'instances'} {{(pid=120770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 07:10:54.834392 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Going to run 1 instances... {{(pid=120770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 07:10:54.836981 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73523852-4128-4cd3-a5e1-b3650aa1041c',volume_size=None,volume_type=None)] {{(pid=120770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 07:10:54.994893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3dde3a66-390d-4ee9-bbb6-feb03a0ed556 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.229765 Aug 31 07:10:54.996341 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 548/1054] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 07:10:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 07:10:55.008964 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-7607b7a7-17f7-4436-ba7c-b33f9cab5895 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:55.009967 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-7607b7a7-17f7-4436-ba7c-b33f9cab5895 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:55.017784 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=4 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:55.019420 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:55.020560 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:10:55.099877 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-7607b7a7-17f7-4436-ba7c-b33f9cab5895 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:55.108573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-7607b7a7-17f7-4436-ba7c-b33f9cab5895 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1088 microversion: 2.1 time: 0.104583 Aug 31 07:10:55.109380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 507/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:55 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1088 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:10:56.131215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:56.132750 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:56.140969 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:56.141714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:56.142344 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:56.143889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:56.144562 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:56.146065 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:56.219574 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:56.234836 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-459df6a0-30bd-4a4c-a53a-994a21427b0b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1186 microversion: 2.1 time: 0.108602 Aug 31 07:10:56.235460 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 549/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:56 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:57.260371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:57.262233 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:57.285797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:57.286523 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:57.287005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:57.287980 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:57.288704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:57.289513 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:57.643372 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:57.657323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-accf5774-e632-4baa-b736-ec50410374aa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1272 microversion: 2.1 time: 0.402554 Aug 31 07:10:57.663592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 508/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:57 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:58.077445 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-2bc216d5-fec3-44a0-9065-ddbf4c698c86 req-eb012072-f44f-43c9-b550-92c60fffeed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7faa24a-9bca-4e67-ba8f-60a38205da7b", "tag": "6c93fe5d-8782-4687-ab54-a54444503c46"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:10:58.089502 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2bc216d5-fec3-44a0-9065-ddbf4c698c86 req-eb012072-f44f-43c9-b550-92c60fffeed7 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:58.090084 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2bc216d5-fec3-44a0-9065-ddbf4c698c86 req-eb012072-f44f-43c9-b550-92c60fffeed7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:58.090787 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2bc216d5-fec3-44a0-9065-ddbf4c698c86 req-eb012072-f44f-43c9-b550-92c60fffeed7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:58.104993 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-2bc216d5-fec3-44a0-9065-ddbf4c698c86 req-eb012072-f44f-43c9-b550-92c60fffeed7 service nova] Creating event network-changed:6c93fe5d-8782-4687-ab54-a54444503c46 for instance e7faa24a-9bca-4e67-ba8f-60a38205da7b on hv-cinder-85528 Aug 31 07:10:58.111144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-2bc216d5-fec3-44a0-9065-ddbf4c698c86 req-eb012072-f44f-43c9-b550-92c60fffeed7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038742 Aug 31 07:10:58.112317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 550/1058] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:10:58.684099 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:58.685398 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:58.692912 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:58.693608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:58.694407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:58.695430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:58.695890 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:58.696488 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:58.874573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:10:58.884107 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0f83e58d-abab-49df-95b8-1325878cabe9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.204120 Aug 31 07:10:58.884984 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 509/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:58 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:10:59.907563 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:10:59.908298 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:10:59.919423 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:59.920661 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:59.921479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:10:59.922759 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:10:59.923423 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:10:59.924002 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:00.088837 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:00.097336 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f99d38cd-1dc5-4f72-a4ab-e74a3a4c03c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.194788 Aug 31 07:11:00.098097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 551/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:10:59 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:01.118065 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:01.118758 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:01.126059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:01.126609 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:01.127358 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:01.128035 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:01.128549 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:01.129033 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:01.273194 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:01.281057 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-200ebb6f-af49-46f5-820f-370c2bf14d6d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.167443 Aug 31 07:11:01.281906 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 510/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:01 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:02.304980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:02.305900 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:02.316757 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:02.317577 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:02.318346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:02.319595 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:02.320294 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:02.320716 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:02.463335 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:02.471473 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-5915203f-a70d-4f38-97d3-b5a13df3b7c1 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.172478 Aug 31 07:11:02.472042 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 552/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:02 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:03.492937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:03.493584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:03.501086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:03.501580 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:03.502014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:03.502769 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:03.503418 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:03.503853 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:03.656487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:03.666242 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-62fa9f52-5f7c-4b4f-8fc4-5b1447f0a207 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.177274 Aug 31 07:11:03.667224 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 511/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:03 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:04.690719 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:04.691733 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:04.700180 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:04.700661 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:04.701081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:04.701806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:04.702251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:04.702685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:04.743172 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:04.767601 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell0:SELECT=6 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:04.878557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:04.887169 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-15bf8381-911d-477a-bcae-142c091c2cfa tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.201738 Aug 31 07:11:04.887748 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 553/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:04 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:05.915934 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:05.916862 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:05.920272 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell0:SELECT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:05.929573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:05.930075 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:05.930511 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:05.931243 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:05.931691 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:05.932115 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:06.073908 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:06.081965 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e60068ab-9e15-47d6-9540-6c09a3d26513 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.172919 Aug 31 07:11:06.094867 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 512/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:05 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:07.105189 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:07.105804 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:07.112813 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:07.113298 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:07.113734 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:07.114419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:07.114878 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:07.115324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:07.252418 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:07.264746 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-6ce973f0-ef79-47f3-96e1-62a74faa6ee2 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.163618 Aug 31 07:11:07.265504 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 554/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:07 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:08.222620 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-de236b4c-2523-4db4-bbb7-c5b56adc907e req-e813abfd-95f5-4da5-9b15-35f8405258eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7faa24a-9bca-4e67-ba8f-60a38205da7b", "name": "network-vif-plugged", "status": "completed", "tag": "6c93fe5d-8782-4687-ab54-a54444503c46"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:08.233234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-de236b4c-2523-4db4-bbb7-c5b56adc907e req-e813abfd-95f5-4da5-9b15-35f8405258eb service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:08.233721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-de236b4c-2523-4db4-bbb7-c5b56adc907e req-e813abfd-95f5-4da5-9b15-35f8405258eb service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:08.234143 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-de236b4c-2523-4db4-bbb7-c5b56adc907e req-e813abfd-95f5-4da5-9b15-35f8405258eb service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:08.246436 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-de236b4c-2523-4db4-bbb7-c5b56adc907e req-e813abfd-95f5-4da5-9b15-35f8405258eb service nova] Creating event network-vif-plugged:6c93fe5d-8782-4687-ab54-a54444503c46 for instance e7faa24a-9bca-4e67-ba8f-60a38205da7b on hv-cinder-85528 Aug 31 07:11:08.251483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-de236b4c-2523-4db4-bbb7-c5b56adc907e req-e813abfd-95f5-4da5-9b15-35f8405258eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032654 Aug 31 07:11:08.252110 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 513/1067] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:08.279286 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:08.279839 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:08.286531 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:08.287118 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:08.287619 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:08.288400 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:08.289027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:08.289624 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:08.289748 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:08.290498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:08.311210 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:08.312096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:08.312462 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:08.313269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:08.313933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:08.314055 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f1ac18f0-d2e0-4d1a-829a-4e6b44e2bfec tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/ips" status: 200 len: 144 microversion: 2.1 time: 0.038681 Aug 31 07:11:08.314745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:08.314889 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 555/1068] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:11:08 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:08.462279 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:08.471033 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-73a3cb79-8c73-47e6-97ee-0462d59c6442 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.186182 Aug 31 07:11:08.471605 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 514/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:08 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:09.494697 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:09.495307 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:09.502173 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:09.502659 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:09.503128 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:09.503836 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:09.504287 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:09.504710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:09.692101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3aff8ef6-f137-4edf-8aec-225701f24948"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:09.694497 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:09.701566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:09.702052 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:09.702502 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:09.703235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:09.703684 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:09.704105 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:09.862035 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:09.870162 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-30f745bb-3643-41d8-82ac-3c94cab31ec8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1260 microversion: 2.1 time: 0.380789 Aug 31 07:11:09.870816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 556/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:09 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1260 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:10.260587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b5a3e062-07bc-494d-8f75-048fae9c1dd0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572466 Aug 31 07:11:10.261387 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 515/1071] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:11:09 2022] POST /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:11:10.890417 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:10.891069 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:10.897754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:10.898241 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:10.898740 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:10.899466 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:10.899948 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:10.900371 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:11.037076 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:11.045895 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-1ed1e733-8876-478e-a82d-e22ebc4bac86 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1445 microversion: 2.1 time: 0.159446 Aug 31 07:11:11.046395 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 557/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:10 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:11.066686 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:11.067407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:11.074400 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:11.074906 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:11.075323 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:11.076011 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:11.076461 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:11.076876 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:11.224566 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:11.237352 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8a4cb7bd-22ef-42ab-aac6-f32054206c84 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1445 microversion: 2.1 time: 0.175116 Aug 31 07:11:11.238371 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 516/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:11 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:13.298996 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-9d41109b-59a5-4198-9fc1-cc403533a5dc req-986e59b1-2f4e-40bb-bd04-9b4db0818341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7faa24a-9bca-4e67-ba8f-60a38205da7b", "tag": "6c93fe5d-8782-4687-ab54-a54444503c46"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:13.308439 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-9d41109b-59a5-4198-9fc1-cc403533a5dc req-986e59b1-2f4e-40bb-bd04-9b4db0818341 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:13.308998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-9d41109b-59a5-4198-9fc1-cc403533a5dc req-986e59b1-2f4e-40bb-bd04-9b4db0818341 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:13.309506 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-9d41109b-59a5-4198-9fc1-cc403533a5dc req-986e59b1-2f4e-40bb-bd04-9b4db0818341 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:13.321027 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-9d41109b-59a5-4198-9fc1-cc403533a5dc req-986e59b1-2f4e-40bb-bd04-9b4db0818341 service nova] Creating event network-changed:6c93fe5d-8782-4687-ab54-a54444503c46 for instance e7faa24a-9bca-4e67-ba8f-60a38205da7b on hv-cinder-85528 Aug 31 07:11:13.326460 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-9d41109b-59a5-4198-9fc1-cc403533a5dc req-986e59b1-2f4e-40bb-bd04-9b4db0818341 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031458 Aug 31 07:11:13.327094 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 558/1074] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:17.835341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:17.837680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:17.846188 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:17.846677 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:17.847156 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:17.847862 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:17.848313 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:17.848733 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:17.881586 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-0a3c5d00-5a08-4d17-b3b6-526dff194972 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050226 Aug 31 07:11:17.882341 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 517/1075] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:11:17 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:17.893968 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:17.894519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:17.901629 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:17.902134 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:17.902560 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:17.903293 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:17.903724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:17.904137 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:17.934353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d78f21a2-1ced-472a-9db8-f0a172317964 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/3aff8ef6-f137-4edf-8aec-225701f24948" status: 200 len: 194 microversion: 2.1 time: 0.044742 Aug 31 07:11:17.934961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 559/1076] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 31 07:11:17 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/3aff8ef6-f137-4edf-8aec-225701f24948 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:19.269537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4783c0da-c1a1-4826-ab1a-25e8362eeba7"}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:19.272097 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:19.279059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:19.279568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:19.280001 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:19.280678 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:19.281118 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:19.281527 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:19.697749 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-190504d5-1813-42fb-b75e-2e86447b7c40 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "POST /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432023 Aug 31 07:11:19.698490 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 518/1077] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 07:11:19 2022] POST /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:27.311085 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:27.313328 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:27.315965 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:27.321575 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:27.322059 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:27.322501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:27.323226 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:27.323683 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:27.324108 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:27.327980 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=59 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:27.357976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-7e9e0d46-55ac-407c-9fdd-cd6b1232bf71 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051459 Aug 31 07:11:27.358523 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 560/1078] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:11:27 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:27.504721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:27.505514 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:27.508117 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=27 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:27.515747 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:27.516229 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:27.516661 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:27.517349 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:27.517796 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:27.518211 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:27.520850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:27.551212 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-870ad35f-4fd3-4e0d-b951-d725a0500e19 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/3aff8ef6-f137-4edf-8aec-225701f24948" status: 200 len: 194 microversion: 2.1 time: 0.053879 Aug 31 07:11:27.551828 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 519/1079] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 31 07:11:27 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/3aff8ef6-f137-4edf-8aec-225701f24948 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:27.562375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:27.562887 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:27.569018 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:27.569486 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:27.569913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:27.570590 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:27.571070 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:27.571485 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:27.655372 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lazy-loading 'services' on Instance uuid 54242f6a-ba12-43cf-b07b-94ac7e239a20 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:11:27.744001 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b15e48d1-697d-49b1-a0c9-b8a50fd18dca tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/3aff8ef6-f137-4edf-8aec-225701f24948" status: 202 len: 0 microversion: 2.1 time: 0.185463 Aug 31 07:11:27.744661 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 561/1080] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:11:27 2022] DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/3aff8ef6-f137-4edf-8aec-225701f24948 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:11:29.934078 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:29.934903 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:29.941498 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:29.941976 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:29.942405 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:29.943122 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:29.943569 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:29.943984 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:29.977448 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e7253548-8c63-4df9-b843-33d99191e357 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/4783c0da-c1a1-4826-ab1a-25e8362eeba7" status: 200 len: 194 microversion: 2.1 time: 0.047355 Aug 31 07:11:29.977993 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 520/1081] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 31 07:11:29 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/4783c0da-c1a1-4826-ab1a-25e8362eeba7 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:29.989501 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:29.990089 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:29.997297 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:29.997865 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:29.998300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:29.999035 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:29.999479 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:29.999893 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:30.083698 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lazy-loading 'services' on Instance uuid 54242f6a-ba12-43cf-b07b-94ac7e239a20 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:11:30.169052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f0c7d5e7-604e-4d91-99b6-fe164792d486 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/4783c0da-c1a1-4826-ab1a-25e8362eeba7" status: 202 len: 0 microversion: 2.1 time: 0.183841 Aug 31 07:11:30.169650 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 562/1082] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 07:11:29 2022] DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments/4783c0da-c1a1-4826-ab1a-25e8362eeba7 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:11:31.347570 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:31.349758 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:31.356543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.357023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.357451 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.358130 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.358573 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.359030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.388185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f0942673-be5e-4dec-8a88-95c3db06f965 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044553 Aug 31 07:11:31.388724 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 521/1083] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:11:31 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 07:11:31.512222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:31.515081 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:31.521503 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.521989 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.522420 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.523145 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.523594 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.524047 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.553564 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-b72d01d3-910f-42fc-841e-521ea3bdf428 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046223 Aug 31 07:11:31.554130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 563/1084] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 07:11:31 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 07:11:31.629715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:31.630439 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:31.639561 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.640178 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.640793 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.641835 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.642481 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.643113 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.671812 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:11:31.755802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-d5d9a06e-fc56-48f8-b98a-52f24e65cef9 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 204 len: 0 microversion: 2.1 time: 0.131701 Aug 31 07:11:31.756422 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 522/1085] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:11:31 2022] DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:11:31.765403 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:31.766186 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:31.772818 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.773313 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.773742 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.774436 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:31.774917 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:31.775346 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:31.918368 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:31.926693 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3400d39f-ba6f-4b38-97ed-895c2171f928 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1671 microversion: 2.1 time: 0.165750 Aug 31 07:11:31.927300 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 564/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:31 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:32.960378 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:32.961347 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:32.970096 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:32.970576 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:32.971043 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:32.971728 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:32.972174 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:32.972592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:33.106550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:33.117939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a5f97a1c-584a-401c-a972-6cd00abdff34 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1671 microversion: 2.1 time: 0.164351 Aug 31 07:11:33.118707 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 523/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:32 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:34.141064 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:34.141810 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:34.148303 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:34.148793 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:34.149222 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:34.149924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:34.150367 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:34.150783 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:34.295283 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:34.303361 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d1a07e9d-5e84-4bfc-a1a0-62569300f805 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1671 microversion: 2.1 time: 0.167816 Aug 31 07:11:34.303936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 565/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:34 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:34.700802 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-2d5926ad-c927-4704-b3c3-322f79c8a879 req-b25610bc-9cab-4cb2-9cdc-5128c6ec38e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54242f6a-ba12-43cf-b07b-94ac7e239a20", "name": "network-vif-deleted", "tag": "7e958dd2-fe48-44ac-aa72-a77a5ce85300"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:34.717588 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-2d5926ad-c927-4704-b3c3-322f79c8a879 req-b25610bc-9cab-4cb2-9cdc-5128c6ec38e6 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:34.718066 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-2d5926ad-c927-4704-b3c3-322f79c8a879 req-b25610bc-9cab-4cb2-9cdc-5128c6ec38e6 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:34.718491 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-2d5926ad-c927-4704-b3c3-322f79c8a879 req-b25610bc-9cab-4cb2-9cdc-5128c6ec38e6 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:34.731074 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-2d5926ad-c927-4704-b3c3-322f79c8a879 req-b25610bc-9cab-4cb2-9cdc-5128c6ec38e6 service nova] Creating event network-vif-deleted:7e958dd2-fe48-44ac-aa72-a77a5ce85300 for instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 on hv-cinder-85528 Aug 31 07:11:34.736928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-2d5926ad-c927-4704-b3c3-322f79c8a879 req-b25610bc-9cab-4cb2-9cdc-5128c6ec38e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039922 Aug 31 07:11:34.737521 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 524/1089] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:35.325984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:35.326815 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:35.335000 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:35.335498 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:35.336006 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:35.336644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:35.337242 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:35.337850 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:35.377215 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:35.378493 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:35.379183 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:35.379877 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.objects.instance [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lazy-loading 'fault' on Instance uuid 54242f6a-ba12-43cf-b07b-94ac7e239a20 {{(pid=120770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:11:35.424736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e97b4b681489e8c427ea3846b62c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fef3f2705c4f77af57dabe57e8f523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:35.432544 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d16138e6-9552-4fa2-bd87-f521df1cabea tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 200 len: 1327 microversion: 2.1 time: 0.110889 Aug 31 07:11:35.433217 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 566/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:35 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:36.458783 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:36.459897 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:36.471263 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:36.472063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:36.472797 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:36.473939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:36.474738 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:36.475514 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:36.492285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] HTTP exception thrown: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Request method failure captured: Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 HTTP/1.1 Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwiQfmiwtD9L2WafMT0WGz3D82OdpwL27kMJ_luEobLn4ijfUEz0VBrrZ2SeqhSW0t5yKPoCzO8wBhuaXCm5o8DFy_f3RG4pH5JnikwZjOIOCQa9KaH9avMUtwM8wMEeRJKruSqrLk5mBBBCQ0_VkSE_HxbntNlQLNsAim_fWSoAjaw Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:11:36.493954 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2fef3f2705c4f77af57dabe57e8f523", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: ce4e97b4b681489e8c427ea3846b62c6 Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:36.495613 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '54242f6a-ba12-43cf-b07b-94ac7e239a20'} Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:36.496650 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:36.498269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:36.499762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Returning 404 to user: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:36.499762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b4eea470-f51b-4557-b146-a49d36a976f0 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 404 len: 111 microversion: 2.1 time: 0.043964 Aug 31 07:11:36.499762 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 525/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:36 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:36.507527 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-92bf5b36-7127-424a-ac09-492f2e53fcd1 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '.version_select at 0x7ff9c09c5ca0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:36.530528 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-92bf5b36-7127-424a-ac09-492f2e53fcd1 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790781645" status: 202 len: 0 microversion: 2.1 time: 0.029556 Aug 31 07:11:36.531150 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 567/1092] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 31 07:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790781645 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:11:39.448249 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:39.448796 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:39.456063 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:39.456550 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:39.456987 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:39.457685 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:39.458128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:39.458592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:39.472704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] HTTP exception thrown: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Request method failure captured: Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 HTTP/1.1 Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwiQfmiwtD9L2WafMT0WGz3D82OdpwL27kMJ_luEobLn4ijfUEz0VBrrZ2SeqhSW0t5yKPoCzO8wBhuaXCm5o8DFy_f3RG4pH5JnikwZjOIOCQa9KaH9avMUtwM8wMEeRJKruSqrLk5mBBBCQ0_VkSE_HxbntNlQLNsAim_fWSoAjaw Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:11:39.474245 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2fef3f2705c4f77af57dabe57e8f523", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: ce4e97b4b681489e8c427ea3846b62c6 Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.475745 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '54242f6a-ba12-43cf-b07b-94ac7e239a20'} Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:39.476621 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.478152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.480021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Returning 404 to user: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:39.480021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-aa0ea463-de9e-4a08-b670-f4014f3eee76 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 404 len: 111 microversion: 2.1 time: 0.031376 Aug 31 07:11:39.480021 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 526/1093] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:11:39 2022] DELETE /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:39.486315 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:39.486831 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 54242f6a-ba12-43cf-b07b-94ac7e239a20] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:39.494780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:39.495378 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:39.495816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:39.496508 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:39.496956 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:39.497376 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:39.510990 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] HTTP exception thrown: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Request method failure captured: Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 HTTP/1.1 Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwiQfmiwtD9L2WafMT0WGz3D82OdpwL27kMJ_luEobLn4ijfUEz0VBrrZ2SeqhSW0t5yKPoCzO8wBhuaXCm5o8DFy_f3RG4pH5JnikwZjOIOCQa9KaH9avMUtwM8wMEeRJKruSqrLk5mBBBCQ0_VkSE_HxbntNlQLNsAim_fWSoAjaw Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:11:39.512639 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2fef3f2705c4f77af57dabe57e8f523", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: ce4e97b4b681489e8c427ea3846b62c6 Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.514147 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '54242f6a-ba12-43cf-b07b-94ac7e239a20'} Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:39.515124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. Aug 31 07:11:39.516653 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:39.518014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Returning 404 to user: Instance 54242f6a-ba12-43cf-b07b-94ac7e239a20 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:39.518014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2ae70e4c-de81-4306-8a76-22decbe898ae tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20" status: 404 len: 111 microversion: 2.1 time: 0.033604 Aug 31 07:11:39.518014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 568/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:39 2022] GET /compute/v2.1/servers/54242f6a-ba12-43cf-b07b-94ac7e239a20 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:40.665740 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:40.666282 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:40.673041 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:40.673591 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:40.674030 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:40.674721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:40.675202 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:40.675647 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:40.689850 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] HTTP exception thrown: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Request method failure captured: Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: DELETE /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af HTTP/1.1 Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwiQfmiwtD9L2WafMT0WGz3D82OdpwL27kMJ_luEobLn4ijfUEz0VBrrZ2SeqhSW0t5yKPoCzO8wBhuaXCm5o8DFy_f3RG4pH5JnikwZjOIOCQa9KaH9avMUtwM8wMEeRJKruSqrLk5mBBBCQ0_VkSE_HxbntNlQLNsAim_fWSoAjaw Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:11:40.691437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2fef3f2705c4f77af57dabe57e8f523", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: ce4e97b4b681489e8c427ea3846b62c6 Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.693059 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '7580179a-eac1-45f0-ab8f-0bb0572699af'} Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:40.693939 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.695285 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.696604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Returning 404 to user: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:40.696604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-12a6de81-4e8e-47e2-9911-1b3753db6a3e tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 404 len: 111 microversion: 2.1 time: 0.031356 Aug 31 07:11:40.696604 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 527/1095] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:11:40 2022] DELETE /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:40.704705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:40.705422 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] [instance: 7580179a-eac1-45f0-ab8f-0bb0572699af] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:40.712318 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:40.712805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:40.713234 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:40.713920 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:40.714369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:40.714782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:40.728641 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] HTTP exception thrown: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Request method failure captured: Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af HTTP/1.1 Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwiQfmiwtD9L2WafMT0WGz3D82OdpwL27kMJ_luEobLn4ijfUEz0VBrrZ2SeqhSW0t5yKPoCzO8wBhuaXCm5o8DFy_f3RG4pH5JnikwZjOIOCQa9KaH9avMUtwM8wMEeRJKruSqrLk5mBBBCQ0_VkSE_HxbntNlQLNsAim_fWSoAjaw Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:11:40.730157 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2fef3f2705c4f77af57dabe57e8f523", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2fef3f2705c4f77af57dabe57e8f523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: a2fef3f2705c4f77af57dabe57e8f523 Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296059061 Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: ce4e97b4b681489e8c427ea3846b62c6 Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-AttachVolumeTestJSON-296059061-project Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.731994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': '7580179a-eac1-45f0-ab8f-0bb0572699af'} Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:40.732927 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. Aug 31 07:11:40.734411 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:40.736389 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] Returning 404 to user: Instance 7580179a-eac1-45f0-ab8f-0bb0572699af could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:40.736389 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c169263a-b1a5-4043-9bd7-343eb32ca841 tempest-AttachVolumeTestJSON-296059061 tempest-AttachVolumeTestJSON-296059061-project] 10.222.0.42 "GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af" status: 404 len: 111 microversion: 2.1 time: 0.033494 Aug 31 07:11:40.736389 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 569/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:40 2022] GET /compute/v2.1/servers/7580179a-eac1-45f0-ab8f-0bb0572699af => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:44.945701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-85337452-a6ec-4b43-b582-3d451b58d517 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Action: 'create', calling method: .version_select at 0x7ff9c15071f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1943562967", "metadata": {"Type": "work"}}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:45.083587 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:45.084126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:45.090537 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:45.091158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:45.091596 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:45.092496 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:45.093204 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:45.093894 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:45.121312 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:11:45.213494 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-53c2163a-90ee-4d53-99d1-0004663a9e3a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 204 len: 0 microversion: 2.1 time: 0.133492 Aug 31 07:11:45.214097 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 570/1097] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:11:45 2022] DELETE /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 07:11:45.283906 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-05b1a4d7-0bc1-47c4-a5d7-a68cd324b281 req-f3b9eeff-292e-452a-8a13-ad6ebc8f454f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fbddfc-3a86-468f-bad3-d2c915367e05", "tag": "485b67c4-c977-4f03-9043-b0e5a030ce01"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:45.296025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-05b1a4d7-0bc1-47c4-a5d7-a68cd324b281 req-f3b9eeff-292e-452a-8a13-ad6ebc8f454f service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:45.296635 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-05b1a4d7-0bc1-47c4-a5d7-a68cd324b281 req-f3b9eeff-292e-452a-8a13-ad6ebc8f454f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:45.297266 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-05b1a4d7-0bc1-47c4-a5d7-a68cd324b281 req-f3b9eeff-292e-452a-8a13-ad6ebc8f454f service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:45.309763 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-05b1a4d7-0bc1-47c4-a5d7-a68cd324b281 req-f3b9eeff-292e-452a-8a13-ad6ebc8f454f service nova] Creating event network-changed:485b67c4-c977-4f03-9043-b0e5a030ce01 for instance d0fbddfc-3a86-468f-bad3-d2c915367e05 on hv-cinder-85528 Aug 31 07:11:45.314754 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-05b1a4d7-0bc1-47c4-a5d7-a68cd324b281 req-f3b9eeff-292e-452a-8a13-ad6ebc8f454f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099132 Aug 31 07:11:45.315724 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 571/1098] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:45.323509 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:45.324210 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:45.330705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:45.331228 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:45.331713 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:45.332419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:45.332871 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:45.333298 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:45.350941 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-85337452-a6ec-4b43-b582-3d451b58d517 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.531959 Aug 31 07:11:45.351829 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 528/1099] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 07:11:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 534 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 07:11:45.367648 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-73efcd04-ab0f-49f0-919e-894ac51a6b73 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Calling method '.version_select at 0x7ff9c0850940>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:45.431524 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-73efcd04-ab0f-49f0-919e-894ac51a6b73 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68" status: 200 len: 353 microversion: 2.1 time: 0.071450 Aug 31 07:11:45.432447 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 529/1100] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:11:45 2022] GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:45.490705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:45.501130 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-723faa08-5026-4bd8-ab9a-af1aecd5be6f tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1578 microversion: 2.1 time: 0.181560 Aug 31 07:11:45.511260 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 572/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:45 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:46.450699 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a2698888-ccae-4cb6-985b-8b1cb7101b7c tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Calling method '.version_select at 0x7ff9c0964af0>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:46.506966 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a2698888-ccae-4cb6-985b-8b1cb7101b7c tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68" status: 200 len: 354 microversion: 2.1 time: 0.063609 Aug 31 07:11:46.507715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 530/1102] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:11:46 2022] GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:46.521387 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-89f37aa6-d164-46b6-a840-d29f704b8744 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Calling method '.version_select at 0x7ff9c0927ee0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:46.521950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:46.522067 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:46.528531 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:46.529019 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:46.529445 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:46.530139 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:46.530582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:46.531025 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:46.584652 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-89f37aa6-d164-46b6-a840-d29f704b8744 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68" status: 200 len: 354 microversion: 2.1 time: 0.067991 Aug 31 07:11:46.585302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 573/1103] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:11:46 2022] GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68 => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:46.602874 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-de9e92e4-5468-4074-ac97-2d18a2e1955c tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Calling method '.version_select at 0x7ff9c06865e0>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:46.672597 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-de9e92e4-5468-4074-ac97-2d18a2e1955c tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68" status: 202 len: 0 microversion: 2.1 time: 0.073780 Aug 31 07:11:46.673780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 574/1104] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 07:11:46 2022] DELETE /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 07:11:46.682020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-946a0c83-d3e9-415c-a87d-5411c6258c5e tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Calling method '.version_select at 0x7ff9c07ec670>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:46.708315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:46.716489 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-626811b1-a69c-4329-b755-2be5cd180332 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1578 microversion: 2.1 time: 0.199008 Aug 31 07:11:46.717173 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 531/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:46 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:46.740079 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-946a0c83-d3e9-415c-a87d-5411c6258c5e tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68" status: 200 len: 353 microversion: 2.1 time: 0.062188 Aug 31 07:11:46.740616 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 575/1106] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:11:46 2022] GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:11:47.563446 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-bd5cf160-b616-476b-9dcc-49c87e5f6d45 req-70116d2d-ac19-4141-bc7b-a1b629304948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fbddfc-3a86-468f-bad3-d2c915367e05", "name": "network-vif-deleted", "tag": "485b67c4-c977-4f03-9043-b0e5a030ce01"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:47.573996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-bd5cf160-b616-476b-9dcc-49c87e5f6d45 req-70116d2d-ac19-4141-bc7b-a1b629304948 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:47.574470 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-bd5cf160-b616-476b-9dcc-49c87e5f6d45 req-70116d2d-ac19-4141-bc7b-a1b629304948 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:47.574917 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-bd5cf160-b616-476b-9dcc-49c87e5f6d45 req-70116d2d-ac19-4141-bc7b-a1b629304948 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:47.586933 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-bd5cf160-b616-476b-9dcc-49c87e5f6d45 req-70116d2d-ac19-4141-bc7b-a1b629304948 service nova] Creating event network-vif-deleted:485b67c4-c977-4f03-9043-b0e5a030ce01 for instance d0fbddfc-3a86-468f-bad3-d2c915367e05 on hv-cinder-85528 Aug 31 07:11:47.592234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-bd5cf160-b616-476b-9dcc-49c87e5f6d45 req-70116d2d-ac19-4141-bc7b-a1b629304948 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Aug 31 07:11:47.593051 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 532/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:47.740305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:47.740892 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:47.747539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:47.748023 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:47.748454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:47.749144 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:47.749595 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:47.750017 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:47.754149 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-493b8634-2ae5-4685-b562-f60c2f3689d5 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Calling method '.version_select at 0x7ff9c0850160>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:47.783049 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-493b8634-2ae5-4685-b562-f60c2f3689d5 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] HTTP exception thrown: Volume c09eaf43-8dec-4447-9ecd-e94508941b68 could not be found. Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-493b8634-2ae5-4685-b562-f60c2f3689d5 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Request method failure captured: Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68 HTTP/1.1 Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwmwxsk35qidu_93u9D8FB9UCridV09r6qiMwhKyNXhVKR_205dpTlWLZpy3NfsiMsb3wFT0ntHI0lRjjiwpUVr9uzgJVT7js-_O_xKz35C4jQyDPo4G1ieGzNpvghvI_d1v0diGA2ov9EtiVHIlSOnYiTWI_aQhCy-QVui7Y4kXJPk Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: 1f947aeedbd9427696ec06c71319a00a Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-VolumesGetTestJSON-929063783 Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:11:47.785426 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1f947aeedbd9427696ec06c71319a00a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1f947aeedbd9427696ec06c71319a00a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1f947aeedbd9427696ec06c71319a00a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1f947aeedbd9427696ec06c71319a00a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-VolumesGetTestJSON-929063783 Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: 1f947aeedbd9427696ec06c71319a00a Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-VolumesGetTestJSON-929063783 Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-VolumesGetTestJSON-929063783-project Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: 17333703137444f4b90507bb8c7480ae Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-VolumesGetTestJSON-929063783-project Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Volume c09eaf43-8dec-4447-9ecd-e94508941b68 could not be found. Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'c09eaf43-8dec-4447-9ecd-e94508941b68'} Aug 31 07:11:47.787315 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c09eaf43-8dec-4447-9ecd-e94508941b68 could not be found. (HTTP 404) (Request-ID: req-1bab0d21-99e3-44f4-9ce8-65d53c1ddc9a) Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:47.788228 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 07:11:47.789441 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c09eaf43-8dec-4447-9ecd-e94508941b68 could not be found. Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 07:11:47.791046 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c09eaf43-8dec-4447-9ecd-e94508941b68 could not be found. Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c09eaf43-8dec-4447-9ecd-e94508941b68 could not be found. Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-493b8634-2ae5-4685-b562-f60c2f3689d5 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] Returning 404 to user: Volume c09eaf43-8dec-4447-9ecd-e94508941b68 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-493b8634-2ae5-4685-b562-f60c2f3689d5 tempest-VolumesGetTestJSON-929063783 tempest-VolumesGetTestJSON-929063783-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68" status: 404 len: 109 microversion: 2.1 time: 0.036870 Aug 31 07:11:47.792634 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 533/1108] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 07:11:47 2022] GET /compute/v2.1/os-volumes/c09eaf43-8dec-4447-9ecd-e94508941b68 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:47.817543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:47.825984 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-8cbd97b8-f1f7-41b7-9efa-5a1012be61b8 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 200 len: 1225 microversion: 2.1 time: 0.090507 Aug 31 07:11:47.829852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 576/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:47 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:48.851093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:48.852380 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: d0fbddfc-3a86-468f-bad3-d2c915367e05] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:48.858729 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:48.859235 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:48.859669 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:48.860354 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:48.860941 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:48.861313 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:48.877407 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] HTTP exception thrown: Instance d0fbddfc-3a86-468f-bad3-d2c915367e05 could not be found. Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Request method failure captured: Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 HTTP/1.1 Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwe2kWEylE_x0GPsXcLJib1B5HN8xwS01LfLMRU9XHgSF0mcmLo0SC6yahnBH0ZFLkDuLDvbfE1ElW29c8ohKMRQTd2MPRZbLdhYmZsyyWpDsc9YmlLDYtu08o1dXZFZe35QY47qSwVXwrudWAkGLEKvXE72XN-rxX5YbPbQhLEQLzs Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:11:48.878997 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea4b3039f2144c18b9d78267241b1a6b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: dcce3144380d4577b91f3e83304f94dd Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance d0fbddfc-3a86-468f-bad3-d2c915367e05 could not be found. Aug 31 07:11:48.880637 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'd0fbddfc-3a86-468f-bad3-d2c915367e05'} Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fbddfc-3a86-468f-bad3-d2c915367e05 could not be found. Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:48.881551 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fbddfc-3a86-468f-bad3-d2c915367e05 could not be found. Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fbddfc-3a86-468f-bad3-d2c915367e05 could not be found. Aug 31 07:11:48.882994 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:48.884269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Returning 404 to user: Instance d0fbddfc-3a86-468f-bad3-d2c915367e05 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:48.884269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-b7d873c8-5ffa-43c4-b847-95193d53fc36 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05" status: 404 len: 111 microversion: 2.1 time: 0.033882 Aug 31 07:11:48.884269 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 534/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:48 2022] GET /compute/v2.1/servers/d0fbddfc-3a86-468f-bad3-d2c915367e05 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:52.016326 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:52.017103 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:52.025142 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:52.025780 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:52.026345 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:52.027324 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:52.027942 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:52.028510 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-976850be-bc52-4d44-9716-ec196a3052cb req-2911a49c-b732-44b0-8506-ad4f500dab94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e827a4-116f-4f06-a229-b9cbe97a02ae", "tag": "39ec3138-7b21-430a-838a-70a49c266afd"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:52.029151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:52.041009 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-976850be-bc52-4d44-9716-ec196a3052cb req-2911a49c-b732-44b0-8506-ad4f500dab94 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:52.041626 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-976850be-bc52-4d44-9716-ec196a3052cb req-2911a49c-b732-44b0-8506-ad4f500dab94 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:52.042304 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-976850be-bc52-4d44-9716-ec196a3052cb req-2911a49c-b732-44b0-8506-ad4f500dab94 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:52.059302 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Going to try to terminate instance {{(pid=120770) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:11:52.060209 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-976850be-bc52-4d44-9716-ec196a3052cb req-2911a49c-b732-44b0-8506-ad4f500dab94 service nova] Creating event network-changed:39ec3138-7b21-430a-838a-70a49c266afd for instance 28e827a4-116f-4f06-a229-b9cbe97a02ae on hv-cinder-85528 Aug 31 07:11:52.067813 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-976850be-bc52-4d44-9716-ec196a3052cb req-2911a49c-b732-44b0-8506-ad4f500dab94 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049233 Aug 31 07:11:52.068715 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 535/1111] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 07:11:52.118149 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:52.156200 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-3581bb03-b9eb-48ae-8756-24e979c00a0c tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "DELETE /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 204 len: 0 microversion: 2.1 time: 0.143852 Aug 31 07:11:52.158330 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 577/1112] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:11:52 2022] DELETE /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:11:52.168563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:52.169584 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:52.177427 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:52.178147 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:52.180023 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:52.181007 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:52.181689 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:52.182381 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:52.332304 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:52.343995 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-35d333ae-8e40-4776-a85b-550af2e79afc tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1577 microversion: 2.1 time: 0.180307 Aug 31 07:11:52.351083 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 536/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:52 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:11:53.369272 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:53.370126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:53.380046 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:53.380609 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:53.381105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:53.381869 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:53.382380 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:53.383110 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:53.586211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:53.597285 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-c24d8b9a-54ae-4605-a416-101ae69f2e0e tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1577 microversion: 2.1 time: 0.234827 Aug 31 07:11:53.599021 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 578/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:53 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:54.495601 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-785c22cf-0b9e-4493-aaec-47d19274387f req-2c13ab49-1422-44bf-a4bf-042ea21b376b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e827a4-116f-4f06-a229-b9cbe97a02ae", "name": "network-vif-deleted", "tag": "39ec3138-7b21-430a-838a-70a49c266afd"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:11:54.505721 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-785c22cf-0b9e-4493-aaec-47d19274387f req-2c13ab49-1422-44bf-a4bf-042ea21b376b service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:54.506192 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-785c22cf-0b9e-4493-aaec-47d19274387f req-2c13ab49-1422-44bf-a4bf-042ea21b376b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:54.506617 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-785c22cf-0b9e-4493-aaec-47d19274387f req-2c13ab49-1422-44bf-a4bf-042ea21b376b service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:54.518106 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.compute.server_external_events [req-785c22cf-0b9e-4493-aaec-47d19274387f req-2c13ab49-1422-44bf-a4bf-042ea21b376b service nova] Creating event network-vif-deleted:39ec3138-7b21-430a-838a-70a49c266afd for instance 28e827a4-116f-4f06-a229-b9cbe97a02ae on hv-cinder-85528 Aug 31 07:11:54.523422 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-785c22cf-0b9e-4493-aaec-47d19274387f req-2c13ab49-1422-44bf-a4bf-042ea21b376b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168361 Aug 31 07:11:54.524239 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 537/1115] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:11:54.619388 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:54.623499 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:54.633925 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:54.634409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:54.634862 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:54.635981 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:54.636322 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:54.637351 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:54.725519 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcce3144380d4577b91f3e83304f94dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4b3039f2144c18b9d78267241b1a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:11:54.735815 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0c9d229e-d099-4708-b6ac-1b51e23379c7 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 200 len: 1225 microversion: 2.1 time: 0.120807 Aug 31 07:11:54.736397 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 579/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:54 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:11:55.757440 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:55.758140 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: 28e827a4-116f-4f06-a229-b9cbe97a02ae] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:55.765090 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:55.765563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:55.766125 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:55.767047 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:55.767937 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:55.768362 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:55.782542 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] HTTP exception thrown: Instance 28e827a4-116f-4f06-a229-b9cbe97a02ae could not be found. Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Request method failure captured: Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae HTTP/1.1 Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwe2kWEylE_x0GPsXcLJib1B5HN8xwS01LfLMRU9XHgSF0mcmLo0SC6yahnBH0ZFLkDuLDvbfE1ElW29c8ohKMRQTd2MPRZbLdhYmZsyyWpDsc9YmlLDYtu08o1dXZFZe35QY47qSwVXwrudWAkGLEKvXE72XN-rxX5YbPbQhLEQLzs Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:11:55.784419 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea4b3039f2144c18b9d78267241b1a6b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: dcce3144380d4577b91f3e83304f94dd Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance 28e827a4-116f-4f06-a229-b9cbe97a02ae could not be found. Aug 31 07:11:55.786134 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': '28e827a4-116f-4f06-a229-b9cbe97a02ae'} Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e827a4-116f-4f06-a229-b9cbe97a02ae could not be found. Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:55.787554 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e827a4-116f-4f06-a229-b9cbe97a02ae could not be found. Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e827a4-116f-4f06-a229-b9cbe97a02ae could not be found. Aug 31 07:11:55.789136 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:55.790516 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Returning 404 to user: Instance 28e827a4-116f-4f06-a229-b9cbe97a02ae could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:55.790516 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e8131320-c4d0-4d9f-8377-faf523105dc2 tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae" status: 404 len: 111 microversion: 2.1 time: 0.032530 Aug 31 07:11:55.790516 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 538/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:55 2022] GET /compute/v2.1/servers/28e827a4-116f-4f06-a229-b9cbe97a02ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:56.251469 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:56.252030 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:56.258994 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:56.259543 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:56.260030 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:56.260785 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:56.261305 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:56.261805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:56.275764 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] HTTP exception thrown: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Request method failure captured: Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: DELETE /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 HTTP/1.1 Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwe2kWEylE_x0GPsXcLJib1B5HN8xwS01LfLMRU9XHgSF0mcmLo0SC6yahnBH0ZFLkDuLDvbfE1ElW29c8ohKMRQTd2MPRZbLdhYmZsyyWpDsc9YmlLDYtu08o1dXZFZe35QY47qSwVXwrudWAkGLEKvXE72XN-rxX5YbPbQhLEQLzs Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:11:56.277454 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea4b3039f2144c18b9d78267241b1a6b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: dcce3144380d4577b91f3e83304f94dd Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.278827 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'de723bf7-b3b4-4f94-ac57-188c9b729f30'} Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:56.279644 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.280905 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.282275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Returning 404 to user: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:56.282275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-18a6669c-8282-496d-8a25-3073aa2ed45b tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 404 len: 111 microversion: 2.1 time: 0.031481 Aug 31 07:11:56.282275 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 580/1118] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:11:56 2022] DELETE /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:56.288282 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:56.289082 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] [instance: de723bf7-b3b4-4f94-ac57-188c9b729f30] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:11:56.311432 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:56.311925 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:56.312359 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:56.313154 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:11:56.313676 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:11:56.314088 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:11:56.332748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.wsgi [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] HTTP exception thrown: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Request method failure captured: Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: request: GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 HTTP/1.1 Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept: application/json Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Accept-Encoding: identity Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Connection: close Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Length: 0 Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Content-Type: application/json Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Host: 10.222.0.42 Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Openstack-System-Scope: None Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: User-Agent: python-urllib3/1.26.12 Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Auth-Token: gAAAAABjDwe2kWEylE_x0GPsXcLJib1B5HN8xwS01LfLMRU9XHgSF0mcmLo0SC6yahnBH0ZFLkDuLDvbfE1ElW29c8ohKMRQTd2MPRZbLdhYmZsyyWpDsc9YmlLDYtu08o1dXZFZe35QY47qSwVXwrudWAkGLEKvXE72XN-rxX5YbPbQhLEQLzs Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Id: None Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Domain-Name: None Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Identity-Status: Confirmed Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Is-Admin-Project: True Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Id: default Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Domain-Name: Default Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Project-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Role: reader,member Aug 31 07:11:56.334257 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Roles: reader,member Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea4b3039f2144c18b9d78267241b1a6b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea4b3039f2144c18b9d78267241b1a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Id: ea4b3039f2144c18b9d78267241b1a6b Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-Tenant-Name: tempest-TestVolumeBootPattern-634316485 Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Id: default Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Domain-Name: Default Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Id: dcce3144380d4577b91f3e83304f94dd Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: X-User-Name: tempest-TestVolumeBootPattern-634316485-project Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: method: > Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: exception: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.335864 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: action_args: {'id': 'de723bf7-b3b4-4f94-ac57-188c9b729f30'} Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:11:56.336701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. Aug 31 07:11:56.338120 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: ERROR nova.api.openstack.wsgi Aug 31 07:11:56.339641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Returning 404 to user: Instance de723bf7-b3b4-4f94-ac57-188c9b729f30 could not be found. {{(pid=120771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:11:56.339641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-095e622d-8f19-4ac4-b2ad-3c178948755a tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30" status: 404 len: 111 microversion: 2.1 time: 0.051621 Aug 31 07:11:56.339641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 539/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:11:56 2022] GET /compute/v2.1/servers/de723bf7-b3b4-4f94-ac57-188c9b729f30 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:11:57.648655 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-f12312db-a8a6-4fef-a57d-8606ae82a1fb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] Calling method '.version_select at 0x7ff9c0650700>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:11:57.656184 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:11:57.675547 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-f12312db-a8a6-4fef-a57d-8606ae82a1fb tempest-TestVolumeBootPattern-634316485 tempest-TestVolumeBootPattern-634316485-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-370224798" status: 202 len: 0 microversion: 2.1 time: 0.030781 Aug 31 07:11:57.676475 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 581/1120] 10.222.0.42 () {58 vars in 1260 bytes} [Wed Aug 31 07:11:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-370224798 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:13:05.771430 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:13:05.772180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:13:05.773587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 07:13:05.774079 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: Wed Aug 31 07:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b/action (ip 10.222.0.42) !!! Aug 31 07:13:05.778483 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:13:05.779928 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:05.789140 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:05.789750 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:05.790221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:05.791042 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:05.791535 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:05.791983 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:05.823375 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.objects.instance [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lazy-loading 'flavor' on Instance uuid e7faa24a-9bca-4e67-ba8f-60a38205da7b {{(pid=120771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 07:13:05.915885 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-ccee011e-b593-41c0-a2a4-f47cf350c2e6 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "POST /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b/action" status: 202 len: 0 microversion: 2.1 time: 0.147404 Aug 31 07:13:05.916473 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 540/1121] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:13:05 2022] POST /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:13:05.923778 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=14 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:13:05.929112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:05.929721 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:05.938401 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:05.938924 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:05.939365 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:05.940068 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:05.940517 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:05.940936 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:06.081539 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:06.092311 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-61da3ea6-c062-4c6e-b74f-6efcaefdb3ad tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.170325 Aug 31 07:13:06.093107 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 582/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:05 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:13:07.120250 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:07.120845 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:07.128466 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:07.129014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:07.129487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:07.130205 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:07.130641 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:07.131086 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:07.262804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:07.270752 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-20518c86-5f96-46f3-a83f-ab600b810866 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.157232 Aug 31 07:13:07.271340 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 541/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:07 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:08.296022 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:08.296700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:08.306809 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:08.307610 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:08.308213 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:08.309219 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:08.309853 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:08.310429 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:08.456961 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:08.467805 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-847545ac-8ea3-4ef1-8d2b-3687abea1fa9 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.178387 Aug 31 07:13:08.468379 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 583/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:08 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:09.492792 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:09.493388 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:09.500993 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:09.501482 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:09.501920 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:09.502616 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:09.503118 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:09.503546 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:09.652383 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:09.664698 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-f916a442-b990-4419-91eb-84dd2c80a31a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.177925 Aug 31 07:13:09.665572 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 542/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:09 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:10.686772 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:10.687374 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:10.694273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:10.694758 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:10.695224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:10.695913 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:10.696361 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:10.696782 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:10.839045 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:10.847340 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-9a945aa5-de57-4360-8c18-6483bc503b8a tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.164540 Aug 31 07:13:10.847876 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 584/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:10 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:11.872832 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:11.873846 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:11.884896 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:11.885542 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:11.885979 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:11.886675 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:11.887152 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:11.887574 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:12.023094 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:12.035681 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-adf1d722-289f-48ff-9bd2-b5246224062f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.169164 Aug 31 07:13:12.036568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 543/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:11 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:13.063098 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:13.063687 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:13.070078 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:13.070557 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:13.071025 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:13.071713 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:13.072158 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:13.072576 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:13.213663 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:13.222154 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-31489077-b499-4942-8d2c-cb281c0ad579 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.165172 Aug 31 07:13:13.222720 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 585/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:13 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:14.251372 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:14.252051 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:14.262062 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:14.262547 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:14.263014 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:14.263701 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:14.264148 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:14.264578 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:14.400772 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:14.409469 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-084a87fb-d167-4adb-a461-0778e9dd6037 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.164423 Aug 31 07:13:14.410005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 544/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:14 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:15.433760 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:15.434358 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:15.437083 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 07:13:15.437209 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Wed Aug 31 07:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b (ip 10.222.0.42) !!! Aug 31 07:13:15.443352 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:15.443824 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:15.444251 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:15.444928 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:15.445369 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:15.445789 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:15.587000 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:15.598779 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0cf6bfad-df7c-4292-a1bd-463276968899 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.170110 Aug 31 07:13:15.599462 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 586/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:15 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:16.621277 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:16.621966 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:16.629230 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:16.629803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:16.630333 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:16.631132 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:16.631582 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:16.632012 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:16.790410 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:16.798408 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e0d57149-05eb-4a21-95d7-aa56cac23a22 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.181137 Aug 31 07:13:16.799010 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 545/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:16 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:17.819196 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:17.819806 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:17.827262 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:17.827743 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:17.828168 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:17.828852 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:17.829296 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:17.829714 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:17.976823 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:17.985375 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-2a6e0fbe-1a62-48b3-a601-15d224574f3d tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.170185 Aug 31 07:13:17.985946 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 587/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:17 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:19.018050 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:19.019056 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:19.029632 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:19.030101 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:19.030530 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:19.031622 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:19.032071 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:19.032487 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:19.181716 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:19.189983 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-4334ff45-e970-4e8f-9aba-a68b1fac9d71 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1570 microversion: 2.1 time: 0.178459 Aug 31 07:13:19.190765 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 546/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:19 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:19.210353 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:13:19.210986 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:19.218057 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:19.218537 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:19.218998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:19.219690 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:19.220138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:19.220555 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:19.251546 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120770) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 07:13:19.321273 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-512e23b9-ed6c-4fd7-b202-f2a5b02ed7d0 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "POST /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b/action" status: 202 len: 0 microversion: 2.1 time: 0.114788 Aug 31 07:13:19.321811 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 588/1134] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 07:13:19 2022] POST /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 07:13:19.330314 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:19.331293 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:19.337935 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:19.338720 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:19.339563 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:19.340635 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:19.341234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:19.341996 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:19.484628 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:19.492615 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e2ecafd7-1d71-4528-81a3-e6c9a4844bcc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1518 microversion: 2.1 time: 0.166323 Aug 31 07:13:19.493185 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 547/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:19 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:20.514535 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:20.515179 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:20.522023 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:20.522518 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:20.522991 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:20.523672 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:20.524124 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:20.524664 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:20.660554 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:20.668394 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-76fb02ad-ee42-431e-a456-656580dec306 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1520 microversion: 2.1 time: 0.158452 Aug 31 07:13:20.669166 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 589/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:20 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:20.763476 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [req-12d62db9-3ce6-4c39-b45a-b9b5d98e04ce req-6b286135-8be7-4e56-b863-4f66aa2abf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7faa24a-9bca-4e67-ba8f-60a38205da7b", "name": "network-vif-unplugged", "status": "completed", "tag": "6c93fe5d-8782-4687-ab54-a54444503c46"}]} {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:13:20.773297 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-12d62db9-3ce6-4c39-b45a-b9b5d98e04ce req-6b286135-8be7-4e56-b863-4f66aa2abf05 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:20.773767 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-12d62db9-3ce6-4c39-b45a-b9b5d98e04ce req-6b286135-8be7-4e56-b863-4f66aa2abf05 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:20.774187 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [req-12d62db9-3ce6-4c39-b45a-b9b5d98e04ce req-6b286135-8be7-4e56-b863-4f66aa2abf05 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:20.786044 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.compute.server_external_events [req-12d62db9-3ce6-4c39-b45a-b9b5d98e04ce req-6b286135-8be7-4e56-b863-4f66aa2abf05 service nova] Unable to find a host for instance e7faa24a-9bca-4e67-ba8f-60a38205da7b. Dropping event network-vif-unplugged {{(pid=120771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 07:13:20.786952 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [req-12d62db9-3ce6-4c39-b45a-b9b5d98e04ce req-6b286135-8be7-4e56-b863-4f66aa2abf05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090761 Aug 31 07:13:20.787543 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 548/1137] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 07:13:21.689810 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:21.690467 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:21.697338 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:21.697822 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:21.698258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:21.699004 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:21.699482 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:21.699904 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:21.837019 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:21.845402 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-0acca6d3-2cac-4829-b724-76a157e5827f tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.159582 Aug 31 07:13:21.845945 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 590/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:21 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:22.866815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:22.867454 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:22.874743 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:22.875265 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:22.875704 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:22.876406 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:22.876863 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:22.877292 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:23.017702 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:23.025706 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-9e47c10e-860c-4b46-8be3-15dac4e05245 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.162861 Aug 31 07:13:23.026254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 549/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:22 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:24.055585 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:24.056602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:24.067138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:24.067616 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:24.068043 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:24.068736 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:24.069178 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:24.069598 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:24.215902 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:24.224549 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-a975e286-9277-4e15-bb2f-56956b478154 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.175508 Aug 31 07:13:24.225112 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 591/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:24 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:25.249234 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:25.249911 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:25.260103 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:25.260773 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:25.261386 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:25.262358 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:25.263005 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:25.263592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:25.402087 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:25.410770 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8b261bcf-3ba6-4b36-aba2-1ea7ad5d9cfc tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.167877 Aug 31 07:13:25.411373 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 550/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:25 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:26.436138 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:26.437179 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:26.445775 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:26.446255 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:26.446685 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:26.447398 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:26.447844 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:26.448258 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:26.590014 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:26.601105 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ed85b218-12a5-4e19-a3d4-0b3466d67e39 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.171323 Aug 31 07:13:26.602093 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 592/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:26 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:27.625568 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:27.630172 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:27.634855 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:27.635355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:27.635786 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:27.636512 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:27.636950 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:27.637369 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:27.792128 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:27.804209 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-8057260c-009c-483d-9670-b0b94f926468 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.182461 Aug 31 07:13:27.804980 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 551/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:27 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:28.829921 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:28.830507 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:28.837491 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:28.837982 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:28.838419 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:28.839152 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:28.839606 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:28.840031 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:29.242934 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:29.250816 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-ad51346f-fc8b-45ac-9d35-fce5366413c8 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.425051 Aug 31 07:13:29.251426 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 593/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:28 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:30.272138 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:30.272748 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:30.279695 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:30.280170 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:30.280965 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:30.281645 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:30.282090 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:30.282537 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:30.421221 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:30.429929 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-bc17088a-766f-4a7a-914d-c612a885de65 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.161813 Aug 31 07:13:30.430542 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 552/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:30 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:30.788921 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-d63177be-e7ff-46a5-a53a-ab6d79167599 req-06c15a6d-e093-4d52-b382-350574172eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7faa24a-9bca-4e67-ba8f-60a38205da7b", "name": "network-vif-plugged", "status": "completed", "tag": "6c93fe5d-8782-4687-ab54-a54444503c46"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:13:30.799224 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d63177be-e7ff-46a5-a53a-ab6d79167599 req-06c15a6d-e093-4d52-b382-350574172eb8 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:30.799695 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d63177be-e7ff-46a5-a53a-ab6d79167599 req-06c15a6d-e093-4d52-b382-350574172eb8 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:30.800126 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-d63177be-e7ff-46a5-a53a-ab6d79167599 req-06c15a6d-e093-4d52-b382-350574172eb8 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:30.811700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-d63177be-e7ff-46a5-a53a-ab6d79167599 req-06c15a6d-e093-4d52-b382-350574172eb8 service nova] Creating event network-vif-plugged:6c93fe5d-8782-4687-ab54-a54444503c46 for instance e7faa24a-9bca-4e67-ba8f-60a38205da7b on hv-cinder-85528 Aug 31 07:13:30.816998 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-d63177be-e7ff-46a5-a53a-ab6d79167599 req-06c15a6d-e093-4d52-b382-350574172eb8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031915 Aug 31 07:13:30.817582 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 594/1146] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:13:31.455324 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:31.456180 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:31.467157 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:31.467957 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:31.468683 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:31.469836 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:31.470608 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:31.471331 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:31.612829 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:31.621587 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-2e145738-42d5-4033-b661-4a7e407a352e tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1576 microversion: 2.1 time: 0.172996 Aug 31 07:13:31.622151 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 553/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:31 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:13:32.647317 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:13:32.647976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:13:32.654727 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:32.655563 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:32.656007 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:32.656700 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:13:32.657151 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:13:32.657569 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:13:32.799909 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:13:32.808240 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-76e1eb10-994e-4715-beae-14f1a887d706 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1563 microversion: 2.1 time: 0.167429 Aug 31 07:13:32.808814 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 595/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:13:32 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:14:49.302437 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_api:SELECT=28 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:14:49.306192 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:14:49.306971 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG dbcounter [-] [120770] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:14:49.308197 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG dbcounter [-] [120771] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 07:14:49.315803 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:14:49.316310 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:14:49.326343 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-4bb030d0-f78b-48dd-8475-d058ce252595 req-9084d5d7-9f16-4f95-b5fc-013342cc3ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7faa24a-9bca-4e67-ba8f-60a38205da7b", "tag": "6c93fe5d-8782-4687-ab54-a54444503c46"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:14:49.335709 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:49.336472 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:49.336875 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:49.341057 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:49.342707 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-4bb030d0-f78b-48dd-8475-d058ce252595 req-9084d5d7-9f16-4f95-b5fc-013342cc3ac7 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:49.343220 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-4bb030d0-f78b-48dd-8475-d058ce252595 req-9084d5d7-9f16-4f95-b5fc-013342cc3ac7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:49.343647 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-4bb030d0-f78b-48dd-8475-d058ce252595 req-9084d5d7-9f16-4f95-b5fc-013342cc3ac7 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:49.345586 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:49.346095 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:49.367212 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-4bb030d0-f78b-48dd-8475-d058ce252595 req-9084d5d7-9f16-4f95-b5fc-013342cc3ac7 service nova] Creating event network-changed:6c93fe5d-8782-4687-ab54-a54444503c46 for instance e7faa24a-9bca-4e67-ba8f-60a38205da7b on hv-cinder-85528 Aug 31 07:14:49.373260 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-4bb030d0-f78b-48dd-8475-d058ce252595 req-9084d5d7-9f16-4f95-b5fc-013342cc3ac7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069099 Aug 31 07:14:49.374052 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 596/1149] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:14:49.390645 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Going to try to terminate instance {{(pid=120771) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 07:14:49.486517 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-27bb967f-d2c1-43da-9122-34bfa3fa6bd4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 204 len: 0 microversion: 2.1 time: 0.185805 Aug 31 07:14:49.490775 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 554/1150] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 07:14:49 2022] DELETE /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 07:14:49.498704 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:14:49.499590 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:14:49.506705 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:49.507435 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:49.508143 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:49.508867 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:49.509440 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:49.509955 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:49.650710 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.policy [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:14:49.659643 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-4dece3e8-1502-49e3-a79a-7388c02419c4 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.167114 Aug 31 07:14:49.660372 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 597/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:14:49 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 07:14:50.682506 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:14:50.683254 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:14:50.690744 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:50.691355 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:50.691783 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:50.692482 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:50.692921 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:50.693336 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:50.892986 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:14:50.901520 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-e803551e-f8bf-445c-9e91-9be66046b973 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1569 microversion: 2.1 time: 0.223445 Aug 31 07:14:50.902093 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 555/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:14:50 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:14:51.741409 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [req-2517ddf6-9f17-4aac-835a-22107639b174 req-b5219c72-5bfd-4abe-9576-d8d23addfa00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7faa24a-9bca-4e67-ba8f-60a38205da7b", "name": "network-vif-deleted", "tag": "6c93fe5d-8782-4687-ab54-a54444503c46"}]} {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 07:14:51.752211 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2517ddf6-9f17-4aac-835a-22107639b174 req-b5219c72-5bfd-4abe-9576-d8d23addfa00 service nova] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:51.752602 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2517ddf6-9f17-4aac-835a-22107639b174 req-b5219c72-5bfd-4abe-9576-d8d23addfa00 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:51.753024 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [req-2517ddf6-9f17-4aac-835a-22107639b174 req-b5219c72-5bfd-4abe-9576-d8d23addfa00 service nova] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:51.766808 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.compute.server_external_events [req-2517ddf6-9f17-4aac-835a-22107639b174 req-b5219c72-5bfd-4abe-9576-d8d23addfa00 service nova] Creating event network-vif-deleted:6c93fe5d-8782-4687-ab54-a54444503c46 for instance e7faa24a-9bca-4e67-ba8f-60a38205da7b on hv-cinder-85528 Aug 31 07:14:51.771976 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [req-2517ddf6-9f17-4aac-835a-22107639b174 req-b5219c72-5bfd-4abe-9576-d8d23addfa00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Aug 31 07:14:51.772896 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 598/1153] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 07:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 07:14:51.933495 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:14:51.934275 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.compute.api [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120771) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:14:51.941321 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:51.941804 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:51.942237 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:51.942956 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:51.943388 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:51.943815 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG oslo_concurrency.lockutils [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:52.006077 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.policy [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1230fdc565e4f3bb475eab921b0bc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac226422ac824de0810f9033dffe4c98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120771) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 07:14:52.014680 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-a17b68da-386a-47f6-bd58-49d68cee429b tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 200 len: 1219 microversion: 2.1 time: 0.087965 Aug 31 07:14:52.015286 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 556/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:14:51 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 07:14:53.038612 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '>' {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:14:53.039310 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.compute.api [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] [instance: e7faa24a-9bca-4e67-ba8f-60a38205da7b] Fetching instance by UUID {{(pid=120770) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 07:14:53.046588 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:53.047086 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:53.047533 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:53.048231 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Acquiring lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 07:14:53.048676 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 07:14:53.049094 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG oslo_concurrency.lockutils [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Lock "9bb752fc-b4d8-4d43-a046-f1c835bf074d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 07:14:53.063020 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.wsgi [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] HTTP exception thrown: Instance e7faa24a-9bca-4e67-ba8f-60a38205da7b could not be found. Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Request method failure captured: Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: request: GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b HTTP/1.1 Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept: application/json Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Accept-Encoding: identity Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Connection: close Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Length: 0 Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Content-Type: application/json Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Host: 10.222.0.42 Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: Openstack-System-Scope: None Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: User-Agent: python-urllib3/1.26.12 Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Auth-Token: gAAAAABjDwlj_BtFtAAZ1CDYaHUTsBqcvUkNNn1Vcazg8KEtb4y9aqM8Mx1WTISuqF2hqeOySjNEzFhnkDb01KqKaBg9YRcOt0xExSAbKsNv7sEhb4LxPMVaxPTrEbqOWYZAvHBANwWiQpC-0Nyjzds4ydEli6pMq9xvW3pPa52oh_p2DRvnY8k Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Id: None Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Domain-Name: None Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Identity-Status: Confirmed Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Is-Admin-Project: True Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Id: default Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Domain-Name: Default Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Id: ac226422ac824de0810f9033dffe4c98 Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Project-Name: tempest-TestShelveInstance-1580758524 Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Role: reader,member Aug 31 07:14:53.064654 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Roles: reader,member Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ac226422ac824de0810f9033dffe4c98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac226422ac824de0810f9033dffe4c98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ac226422ac824de0810f9033dffe4c98", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac226422ac824de0810f9033dffe4c98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant: tempest-TestShelveInstance-1580758524 Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Id: ac226422ac824de0810f9033dffe4c98 Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-Tenant-Name: tempest-TestShelveInstance-1580758524 Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User: tempest-TestShelveInstance-1580758524-project Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Id: default Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Domain-Name: Default Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Id: c1230fdc565e4f3bb475eab921b0bc7d Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: X-User-Name: tempest-TestShelveInstance-1580758524-project Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: method: > Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: exception: Instance e7faa24a-9bca-4e67-ba8f-60a38205da7b could not be found. Aug 31 07:14:53.066483 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: action_args: {'id': 'e7faa24a-9bca-4e67-ba8f-60a38205da7b'} Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: {{(pid=120770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7faa24a-9bca-4e67-ba8f-60a38205da7b could not be found. Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 07:14:53.067605 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7faa24a-9bca-4e67-ba8f-60a38205da7b could not be found. Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7faa24a-9bca-4e67-ba8f-60a38205da7b could not be found. Aug 31 07:14:53.069304 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: ERROR nova.api.openstack.wsgi Aug 31 07:14:53.070829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: DEBUG nova.api.openstack.wsgi [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Returning 404 to user: Instance e7faa24a-9bca-4e67-ba8f-60a38205da7b could not be found. {{(pid=120770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 07:14:53.070829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: INFO nova.api.openstack.requestlog [None req-d49d8e8f-2cc5-4ab8-b5ac-dafeb2dec7ec tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b" status: 404 len: 111 microversion: 2.1 time: 0.032300 Aug 31 07:14:53.070829 dv-cinder-855288-3-iscsi devstack@n-api.service[120770]: [pid: 120770|app: 0|req: 599/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 07:14:53 2022] GET /compute/v2.1/servers/e7faa24a-9bca-4e67-ba8f-60a38205da7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 07:14:53.234956 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: DEBUG nova.api.openstack.wsgi [None req-cab644c9-7ee7-4f98-acb6-4cb702700a27 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] Calling method '.version_select at 0x7ff9c1ece5e0>' {{(pid=120771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 07:14:53.260592 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: INFO nova.api.openstack.requestlog [None req-cab644c9-7ee7-4f98-acb6-4cb702700a27 tempest-TestShelveInstance-1580758524 tempest-TestShelveInstance-1580758524-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1860514809" status: 202 len: 0 microversion: 2.1 time: 0.032627 Aug 31 07:14:53.261029 dv-cinder-855288-3-iscsi devstack@n-api.service[120771]: [pid: 120771|app: 0|req: 557/1156] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Aug 31 07:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1860514809 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)